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FOREWORD 


This  handbook  was  prepared  by  the  U .  S.  Army  Management 
Engineering  Training  Agency  under  the  technical  direction  of 
the  Quality  Assurance  Directorate,  Headquarters,  AMC .  It  is 
intended  to  serve  as  a  guide  for  project  and  commodity  managers 
and  professional  personnel  in  the  planning,  direction,  and  mon¬ 
itoring  of  reliability  programs.  While  not  regulatory  in  nature, 
the  material  in  the  handbook  is  applicable  to  both  in-house  and 
contracted-f or  effort. 

The  format  of  the  handbook  is  such  that  there  are  seven  basic 
chapters  with  appendixes  topically  aligned  to  each.  The  material 
in  the  chapters  is  in  narrative  form  and  provides  a  simple, 
straightforward  approach  to  the  life  cycle  aspects  of  reliability 
without  reaorting  !  to  language  of  a  mathematical  or  highly  technical 
nature.  Included  in  each  chapter  are  topics  which  should  be  con¬ 
sidered  for  that  phase  of  the  reliability  program  in  the  product 
life  cycle.  The  discussion  which  follows  each  of  these  topics 
contains  a  brief  explanation  to  provide  guidance  for  the  develop¬ 
ment,  monitoring,  or  evaluation  of  reliability  as  it  pertains  to 
that  element  of  total  system  performance. 

The  appendixes  contain  technical  discussions  and  mathematical 
treatments  of  techniques  as  they  apply  to  the  narrative  in  the 
chapters.  Examples,  applications,  and  solutions  are  included. 

It  is  felt  that  this  twofold  approach  to  the  subject  lends  itself 
to  use  by  the  manager  and/or  generalist,  as  well  as  the  practitioner. 
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CHAPTER  1 
INTRODUCTION 

Section  I.  RELIABILITY  AS  A  PROGRAM  ELEMENT 

»  1-1.  The  importance  of  reliability  to  system  effectiveness,  a.  Relia¬ 

bility  is  defined  as  the  probability  that  ail  item*  will  perform  its  intended 
function  for  a  specified  interval  under  stated  conditions.  As  it  relates  to 
ll  Army  systems,  equipments,  components,  and  parts,  reliability  is  one  of 

the  important  characteristics  by  which  the  usefulness  of  an  item  is  judged. 

b.  Usefulness  is  measv  .  i  in  terms  of  an  item's  effectiveness 
for  its  intended  role;  therefore,  ;  eliability  is  one  of  the  important  param¬ 
eters  contributing  to  effectiveness.  As  roles  and  mission  requirements 
become  more  sophisticated,  items  become  more  complex  in  the  functional 
configuration  necessary  to  satisfy  increased  performance  requirements. 

As  item  complexity  increases,  reliability  invariably  becomes  more  prob¬ 
lematical  and  elusive  as  a  design  parameter,  and  thus  more  difficult  to 
assure  as  an  operational  characteristic  under  the  projected  conditions  of 
use.  These  difficulties  can  never  be  completely  eliminated,  but  may  be 
reduced  by  means  of  the  establishment  and  implementation  of  sound  re¬ 
liability  program  activities. 

c.  It  is  also  now  recognized  that  with  the  exercise  of  very  de¬ 
liberate  and  positive  reliability  engineering  methods  throughout  the  life 
cycle  of  the  item- -from  the  early  planning  sta  ,es  through  design,  devel¬ 
opment,  production,  and  field  use--the  ieasi-.e  reliability  level  can 
usually  be  attained.  Like  other  system  characteristics,  reliability  is  a 
quantitative  characteristic:  predictable  in  design,  measurable  in  test, 

»  controllable  in  production,  and  sustainable  in  the  field.  It  follows  that 

reliability  may  be  achieved  by  introducing  sound  monitoring  practices 
with  corrective  action  criteria  at  key  points  throughout  the  life  cycle. 


In  this  document,  the  words  item,  equipment,  and  system  are  used 
inter  change ably. 
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1-2.  Purpose  and  scope  of  the  handbook,  a.  This  handbook  provides 
procedures  for  the  definition,  pursuit,  and  acquisition  of  required  re¬ 
liability  in  Army  systems,  equipments,  and  components.  The  methods 
presented  are  generally  applicable  to  all  categories  of  items,  including 
electronic,  electromechanical,  mechanical,  hydraulic,  and  chemical. 
However,  examples  chosen  to  illustrate  the  application  of  specific  pro¬ 
cedures  are  drawn  largely  from  experience  with  electronic  and  electro¬ 
mechanical  systems  because  of  the  availability  of  documented  experience 
with  these  systems. 

b.  The  document  is  not  intended  to  provide  detailed  instructions 
relative  to  any  specific  program  or  equipment,  but  is  intended  to  fill 
three  basic  needs  within  the  Army  and  its  contractor  facilities. 

(1)  Project  management.  General  guidance  for  the  imple¬ 
mentation  of  selected  reliability  program  functions  at  appropriate  points 
in  the  item  life  cycle. 

(2)  Project  engineering.  Discussion  of  some  procedures 
useful  to  the  engineer  in  the  actual  performance  of  these  reliability  pro¬ 
gram  functions. 

(3)  Design  engineering.  Identification  of  some  important 
principles  affecting  reliability  and  some  analytic  techniques  for  predict¬ 
ing  and  measuring  the  reliability  of  a  given  design  configuration. 

1-3.  Reliability  as  a  growth  process,  a.  As  an  item  proceeds  through 
the  stages  of  the  life  cycle,  reliability  should  be  periodically  predicted  or 
estimated.  These  values,  when  plotted  at  selected  points  in  the  life  cycle, 
result  in  a  growth  curve  which  reflects  comparative  reliability  levels. 

This  growth  curve  provides  a  source  of  information  useful  to  decision 
makers  relative  to  actions  affecting  reliability.  Figure  1-1  indicates  the 
relationship  between  certain  key  monitoring  activities  and  a  typical  re¬ 
liability  growth  curve.  The  slope  of  an  actual  reliability  growth  curve 
is  dependent  upon  interactions  among  effectiveness  characteristics. 
Consequently,  a  curve  generated  during  a  specific  program  may  exhibit 
a  pattern  of  growth  different  from  that  shown  in  figure  1-1. 
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b.  Desirable  reliability  growth  results  from  planning,  design¬ 
ing,  testing,  producing,  and  ultimately  using  the  product  according  to  a 
set  of  effectiveness-oriented  procedures.  Lack  of  reliability  growth 
may  result  from  overlooking  or  disregarding  these  same  procedures  at 
any  single  point  in  the  growth  process. 

1-4.  Organization  and  use  of  the  handbook.  Figure  1-2  identifies 

applicable  chapters  within  the  handbook  corresponding  to  major  relia-  i 

bility  functions  to  be  performed  throughout  the  life  cycle  of  a  system. 

The  figure  may  also  serve  as  a  basic  checklist  of  things  to  be  done  in 
planning  a  new  program.  Not  all  of  these  functions  are  applicable  for 
all  materiel  items,  e.  g,  ,  those  items  for  which  a  Research  and  Tech¬ 
nology  Resum£  (DD  Form  1498)  is  used  instead  of  a  Technical  Develop¬ 
ment  Plan  (TDP). 2 
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Figure  1-2 

Reference  Index  for  the  Performance  of 
Some  Specific  Reliability  Functions 


2  i 

Where  Technical  Development  Plan  is  used  in  this  Pamphlet,  System  1 

Development  Plan  (SDP)  is  also  included.  j 
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Section  II.  RELIABILITY  DOCUMENTS  APPLICABLE  TO  THE 
MATERIEL  LIFE  CYCLE 

1-5.  The  materiel  life  cycle,  a.  For  purposes  of  discussion,  the 
materiel  life  cycle  is  broken  into  the  following  six  phases: 

(1)  Conceptual  phase.  The  life  cycle  is  initiated  by  a  state¬ 
ment  of  general  need  for  a  particular  capability.  The  general  objective 
of  this  phase  is  to  establish  a  feasible  technical  approach  for  satisfying 
the  general  requirements,  to  evaluate  whether  a  specific  approach  is 
worth  pursuing,  or  whether  the  military  requirement  should  be  satisfied 
in  another  manner.  If  the  approach  is  found  to  be  worth  pursuing,  the 
conceptual  phase  should: 

(a)  Provide  explicit  definition  of  effectiveness  for  the 
particular  item  under  consideration;  and 

(b)  Provide  guidelines  for  item  refinement  in  the  defi¬ 
nition  phase. 

(2)  Definition  phase,  (a)  During  the  definition  phase,  the 
detailed  cost,  schedule  and  technical  design  requirements  of  a  program 
are  defined  and  validated  prior  to  development  and  production.  Tech¬ 
nological  advances  resulting  from  the  conceptual  phase  are  translated 
into  design  requirements  to  be  met  during  development  and  production. 

(b)  The  definition  phase  serves  to  refine  the  system 
definition  to  subsystem  level  based  on  the  guidelines  established  during 
the  conceptual  phase.  Thus,  it  enhances  the  probability  of  successful 
accomplishment  of  these  requirements  and  allows  development  to  pro¬ 
ceed  with  minimum  change.  This  phase  provides  the  inputs  to  a  request 
for  proposal  and  the  resulting  contractor  competition  for  development. 

(3)  Development  phase.  The  development  phase  is  the 
period  during  which  design  engineering  and  testing  is  performed  to  come 
up  with  an  end  item  which  satisfies  the  military  requirement.  The  main 
product  of  the  development  phase  is  documentation  of  information  for  use 
in  production  of  the  end  item  for  field  use.  Items  produced  during  this 
phase  generally  serve  to  test  the  effectiveness  of  the  research  and  the 
validity  of  the  data.  The  design  and  configuration  is  determined  during 
this  phase,  and  the  inherent  reliability  is  established.  Inherent  relia¬ 
bility  refers  to  the  achievable  reliability  of  the  equipment  under  ideal 
environmental  conditions. 
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(4)  Production  phase.  The  production  phase  utilizes  the 
technical  data  package  formulated  during  the  development  phase  to 
produce,  manufacture,  and  make  engineering  changes  to  the  item 
under  consideration.  This  phase  includes  production  testing  and 
arranging  for  facilities  and  logistic  support. 

(5)  Operational  phase.  This  phase  is  characterized  by  re¬ 
build,  supply,  training,  maintenance,  and  materiel  readiness  operations 
while  the  system  is  being  utilized  by  an  operational  unit.  It  is  here 
that  the  results  of  all  prior  effort  is  put  to  the  test  in  the  field.  How¬ 
ever,  this  phase  is  not  independent  of  preceding  phases;  e.  g. ,  inherent 
reliability  established  in  design  can  be  realized  only  if  support  activities 
are  performed  as  epecitied.  Feedback  data  from  this  phase  can  be  uti¬ 
lized  for  improving  reliability,  either  by  engineering  changes  in  the 
present  system  or  in  the  development  of  new  systems. 

(6)  Disposal  phase.  This  phase  is  inducted  in  this  doc¬ 

ument  to  complete  the  life  cycle.  It  has  to  do  with  the  removal  of  obsolete 
items  from  the  inventory  and  consequently  has  little  influence  on  reliability. 

b.  The  major  reliability  system  life  cycle  considerations  are 
shown  in  figure  1-3. 

c.  A  great  many  documents  support  the  overal;  Army  reliability 
program.  These  are  intended  to  give  assurance  that  each  item  ultimately 
satisfies  the  need  initially  anticipated.  Figure  1-4  shows  many  of  the  doc¬ 
uments  related  to  the  appropriate  considerations  in  figure  1-3. 

d.  Some  of  these  documents  identify  certain  engineering  or  man¬ 
agement  procedures,  test  plans,  and  data  requirements  which  are  needed 
to  fulfill  contractual  requirements.  Similar  requirements  are  implicitly 
defined  in  others.  In  general,  they  impose  a  responsibility  upon  the  proj¬ 
ect  office,  contractor,  or  contracting  agency  to  do  certain  things  to  assure 
ultimate  realization  of  required  reliability  in  the  field.  References  which 
supplement  the  contents  of  the  documents  are  identified  in  the  documents 
themselves.  Figure  1-5  is  an  abbreviated  document  directory.  Opposite 
each  document  identification  number  are  indicated  those  sections  of  this 
handbook  that  relate  to  these  requirements. 
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RELIABILITY  PROGRAM  ACTIVITIES 


(T)  NEED  for  reliability  must  be  anticipated. 

(2)  Qualitative  Materiel  Requirements  (QMR)  or  Small 
Development  Requirements  (SDR)  must  reflect  this  need. 

G)  Plans  must  be  formulated  to  fulfill  the  reliability  need,  such 
as:  (a)  Reliability  requirements  defined  and  specified;  (b)  Reliability 
program  plan  formalized;  (c)  Requests  for  proposal  (RFP)  and  contracts 
documented. 

G)  Reliability  program  is  implemented;  Reliability  is  monitored 
continuously. 

(?)  Conceptual  item  is  designed:  Reliability  is  assessed  in  de¬ 
sign  review;  design  is  revised  to  correct  deficiencies;  reliability  is 
designed  in  by  requirement. 

( 6 )  Prototype  is  developed  according  to  the  design:  Reliability 

is  evaluated  by  test;  design  is  refined  to  correct  deficiencies;  reliability 
is  validated  by  demonstration  when  practical. 

(T)  Item  is  produced:  Parts,  materials,  and  processes  are 
controlled;  equipment  acceptability  is  determined  by  test. 

(?)  Item  is  deployed  to  the  field:  Operators  and  maintenance 
technicians  are  trained;  operating  and  maintenance  instructions  are 
distributed;  reliability  is  sustained  by  procedure. 

(9)  Item  is  evaluated  to  determine  that  the  original  need  is  met. 

(ft)  Feedback  loop  completes  the  cycle:  (a)  to  guide  product  im¬ 
provements;  (b)  to  guide  future  development  planning;  (c)  to  correct  field 
deficiencie  s . 


Figure  1 -3 

Reliability  Considerations  in  the  Materiel  Life  Cycle 
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CIRCLED  NUMBERS  CORRESPOND  TO  THOSE  IN  FIGURE  1-3 


O00000000 © 

I  I-  I  ..  J  - 1 - 

AR  705-5 


MIL -STD -756  A  L 

4120.  3-M  (AR  715-10) 


;  MiL-HDBK-217A 

MIL -STD -7 81 A 

!  MIL -STD  -  105D 

MIL-STD-414 

j  MIL-STD- 1235 

{  HI  08 

TR-3 
TR-4 
TR-6 
TR-7 


MIL -STD -6  90 A 
MIL -STD -7  90 A 


MIL-STD-785 
AR  705-50 
AMCR  700-15 
MIL -STD -72  IB 
MIL-Q-9858A 
AMCR  702-8 


Figure  1  -4 

Documents  Applicable  to  Materiel  Life  Cycle 
Reliability  Considerations 

Note .  See  section  V  for  document  titles. 
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Section  III.  RELATIONSHIP  OF  RELIABILITY 
TO  SYSTEM  EFFECTIVENESS 

1-6.  System  effectiveness,  a.  The  worth  of  a  particular  item  is 
determined  primarily  by  the  effectiveness  with  which  it  does  its  job. 

Many  characteristics,  including  reliability,  contribute  to  system  (item) 
effectiveness.  For  purposes  of  discussion,  effectivenes  s  -  related  charac¬ 
teristics  may  be  grouped  into  three  general  categories: 

(1)  Those  affecting  response  to  a  mission  call. 

(2)  Those  affecting  endurance  of  item  operation. 

(3)  Those  comprising  terminal  results  of  the  mission. 

b.  The  contributions  of  these  categories  may  be  referred  to  as 
availability,  dependability,  and  capability,  respectively,  (see  figure  1-6). 
Then  system  effectiveness  may  be  expressed  as  a  function  of  availability, 
dependability,  and  capability. 

(1)  Availability  is  a  measure  of  the  degree  to  which  an  item 
is  in  the  operable  and  committable  state  at  the  start  of  the  mission  when 
the  mission  is  called  for  at  an  unknown  (random)  point  in  time. 

(2)  Dependability  is  a  measure  of  the  item  operating  condi¬ 
tion  at  one  or  more  points  during  the  mission,  including  the  effects  of 
reliability,  maintainability,  and  survivability,  given  the  item  condition(s) 
at  the  start  of  the  mission.  It  may  be  stated  as  the  probability  that  an 
item  will  enter  or  occupy  one  of  its  required  operational  modes  during 

a  specified  mission  and  perform  the  functions  associated  with  those 
operational  modes. 

(3)  Capability  is  a  measure  of  the  ability  of  an  item  to  achieve 
mission  objectives,  given  the  conditions  during  the  mission. 
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Figure  1-6 

Definition  ol'  System  Effectiveness"1 

c.  Other  factors,  such  as  time,  cost,  and  logistic  supporta- 
bility ,  enter  into  an  evaluation  of  an  item  during  systim  planning. 

Within  the  constraints  imposed  by  such  factors,  effectiveness  should  be 
optimized  by  judicious  balance  among  the  characteristics  comprising 
availability,  dependability,  and  capability,  taking  care  not  to  stress  the 
importance  of  one  at  the  exclusion  of  the  others. 

d.  Reliability  is  an  important  part  of  the  effectiveness  model, 
especially  in  availability  and  dependability.  With  reference  to  availa¬ 
bility,  reliability  pertains  to  the  environment  to  which  an  item  is  sub¬ 
jected  while  awaiting  initiation  of  its  primary  mission;  e.g.  ,  storage, 
temporary  use,  war  games,  etc.  As  a  contributor  to  dependability, 
reliability  concepts  pertain  to  the  environment  to  which  the  item  is 
subjected  during  its  primary  mission. 

e.  The  descriptor  s ,  availability,  dependability,  and  capability, 
have  been  chosen  for  discussion  of  effectiveness.  Other  system  effec¬ 
tiveness  approaches  have  been  formulated  using  different  descriptor 
categories . 


^The  approach  used  here-  is  that  of  WSEIAC  Comnvtlce  Reports. 4 
4See  footnote  7,  page  1-17. 
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Section  IV.  QUANTITATIVE  DESCRIPTION 
OF  A  RELIABILITY  LEVEL 

1-7.  Definitions  of  reliability,  a.  The  reliability  of  an  item  is  de¬ 
fined  as  the  probability  that  the  item  will  perform  its  intended  function 
for  a  specified  interval  under  stated  conditions.  When  applied  to  a  spe¬ 
cific  equipment  or  system,  reliability  is  frequently  defined  as: 

(1)  The  probability  of  satisfactory  performance  for  specified 
time  and  use  conditions;  or 

(2)  The  probability  of  a  successful  mission  of  specified  dura¬ 
tion  under  specified  use  conditions;  or 

(3)  The  probability  of  a  successful  event  under  specified 
conditions.  This  definition  is  particularly  applicable  to  nontime  depend¬ 
ent  items. 


b.  Whenever  the  definition  is  worded  to  fit  a  particular  item  or 
device,  it  is  always  necessary  to; 

(1)  Relate  probability  to  a  precise  definition  of  success  or 
satisfactory  performance; 

(2)  Specify  the  time  base  or  operating  cycles  over  which 
such  performance  is  to  be  sustained  (except  for  nonlime  dependent  items 
such  as  one  shot  devices);  and 

(3)  Specify  the  environmental  or  use  conditions  which  will 

prevail. 

1-8.  Reliability  descriptors.  A  reliability  level,  and  ultimately  a  re¬ 
liability  requirement,  may  be  stated  by  using  various  descriptors.  Any 
of  the  following  may  be  used  to  specify  a  reliability  requirement  for  a 
given  mission  time. 

a.  Both  mission  time  and  the  reliability  associated  with  that 
mission  time;  (i.e.  ,  the  probability  that  the  equipment  will  not  fail  dur¬ 
ing  the  required  mission  time).  Such  a  requirement  statement  reflects 
the  reliability  definition. 
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b.  Mean  time  between  failures  (iMTBF).^  This  descriptor 
reflects  a  specific  reliability  level  only  if  the  relationships  between 
MTBF  and  reliability  level  is  known.  If  different  relationships  apply 
to  two  items,  it  is  highly  likely  that  the  same  MTBF  for  both  items 
will  reflect  different  reliability  levels.  Thus,  MTBF  should  be  used 
with  caution  to  express  reliability  requirements. 

c.  Failure  rate.  Failure  rate  may  be  used  to  express  relia¬ 
bility  requirements  with  the  same  type  of  precautions  described  for 
MTBF. 


d.  Probability  of  properly  performing  a  specific  function. 

This  descriptor  is  useful  ior  expressing  reliability  requirements  tor 
noruime  dependent  items. 

Section  V.  DOCUMENTS  APPLICABLE  TO  THE 
ARMY  RELIABILITY  PROGRAM 

i-9.  Synopses  of  reliability  documents.  A  brief  synopsis  for  each  of 
the  documents  shown  in  figure  1-4  follows. 

a.  AR  705-50,  Army  Materiel  Reliability  and  Maintainability , 
Sets  forth  concepts,  objectives,  responsibilities,  and  general  policies 
for  the  Army  reliability  and  maintainability  program.  This  regulation 
identifies  reliability  and  maintainability  characteristics  which  must  be 
specified  for  the  design  of  materiel  and  must  be  considered  and  assessed 
throughout  the  life  cycle, 

b .  MIL-STD-785,  Requirements  for  Reliability  Program  (for 
Systems  and  Equipments).  Provides  general  requirements  for  relia¬ 
bility  programs,  as  well  as  guidelines  for  the  preparation  of  reliability 
program  plans.  Particular  attention  is  directed  toward  the  topics  of 
numerical  reliability  objectives  and  minimum  acceptable  requirements. 
Approval  of  or  deviation  from  the  proposed  reliability  plan,  preplanned 


^F or  nonrepairable  items,  mean  time  to  failure  (MTF)  may  be  used  in 
lieu  of  MTBF.  These  terms  are  frequently  ustd  interchangeably. 


fcThie  relationship  depends  upon  the  probability  distribution  function 
of  failure  times.  Some  important  probability  distribution  functions  are 
summarized  in  appendix  A. 
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program  review  check  points,  itemization  of  government-furnished  or 
contractor  -  supplied  equipment,  which  is  to  be  integrated  to  provide  a 
complete  operational  system,  are  also  emphasized.  In  addition,  human 
engineering  design  criteria  reference  documents,  a  list  of  items  to  be 
included  in  failure  report  form,  milestones  at  which  demonstration  is 
to  be  performed,  and  the  reliability  test  plan  are  included, 

c.  AMCR  700-  15,  Reliability  Program  for  AMC  Materiel. 
Establishes  policies,  procedures,  and  responsibilities  concerning  a  re¬ 
liability  program  for  Army  materiel.  Included  is  a  listing  of  essential 
factors  to  be  considered  in  a  reliability  program,  as  well  as  essential 
phases  during  which  reliability  actions  must  be  taken. 

d.  MIL-Q-9858A,  Quality  Program  Requirements.  Specifies 
requirements  for  an  effective  and  economical  quality  program,  planned 
and  developed  in  consonance  with  the  contractor's  other  administrative 
and  technical  programs.  Design  of  the  program  shall  be  based  upon 
consideration  of  the  technical  and  manufacturing  aspects  of  production 
and  related  engineering  design  and  materials. 

e.  MIL-STD- 105D,  Sampling  Procedures  and  Tables  for 
Inspection  by  Attributes.  Provides  tabled  acceptance  sampling  plans 
and  general  procedures  for  deciding  whether  a  lot  of  components,  sub¬ 
systems,  systems,  etc.,  have  an  acceptable  percentage  defective  when 
compared  to  specification  limits  or  goals.  Specification  of  a  mission 
profile  allows  for  usage  for  reliability  acceptance  plans. 

f .  MIL-STD-414,  Sampling  Procedures  and  Tables  for  Inspec¬ 
tion  by  Variables  for  Percent  Defective.  Provides  general  procedures 
and  sampling  plans  for  determining  acceptance  of  lots  when  quality  is 
based  on  a  characteristic  which  is  measured  on  a  continuous  scale,  and 
the  measurements  and  the  underlying  distribution  are  normal.  These 
plans  may  be  applied  to  reliability  tests  if  a  mission  time  is  specified. 

g.  MIL-STD  -  72  1  B,  Definition  of  Effectiveness  Terms  for 
Reliability,  Maintainability,  Human  Factors,  and  Safety.  Defines  terms 
commonly  used  in  reliability,  maintainability,  human  factors,  and 
safety. 
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h.  MIL-STD-756A,  Reliability  Prediction.  Establishes  uni¬ 
form  procedures  for  predicting  the  quantitative  reliability  of  aircraft, 
missiles,  electronic  equipment,  and  their  subdivisions  early  in  the 
development  phases,  to  reveal  design  reliability  weaknesses  and  to 
form  a  basis  for  apportionment  of  reliability  requirements  to  the 
various  subdivisions  of  the  item.  Graphically  portrays  the  effects 
of  system  complexity  on  reliability  to  permit  the  early  prediction  of 
tolerance  and  interaction  problems  not  accounted  for  in  the  simple 
multiplicative  case,  and  provides  appropriate  factors  by  which  to 
adjust  MIL-HDBK-21  7A  predictions  for  airborne  and  missile  environ¬ 
ments. 


i .  MIL-STD  -  78 1  A,  Reliability  Tests,  Exponential  Distribution. 
Outlines  a  series  of  test  levels  and  test  plans  for  certain  reliability 
acceptance  tests  and  longevity  tests.  The  test  plans  are  based  upon  the 
exponential  (or  Poisson)  distribution. 

j .  M1L-STD-690A,  Failure  Rate  Sampling  Plans  and  Proce¬ 
dures.  Provides  procedures  for  failure  rate  qualification  sampling 
plans  for  establishing  and  maintaining  failure  rate  levels  at  selected 
confidence  levels  and  lot  conformance  inspection  procedures  associated 
with  failure  rate  testing. 

k .  MIL-STD-790A,  Reliability  Assurance  Program  for  Elec  - 
tronic  Parts  Specifications.  Provides  the  controls  and  procedures  a 
manufacturer  must  establish  and  continue  to  maintain  in  order  to  qualify 
parts  to  an  established  reliability  level. 

l .  MIL-STD- 1 2 35 ,  Sampling  Procedures  and  Tables  for  Con¬ 
tinuous  Inspection  by  Attributes.  Provides  tabled  acceptance  sampling 
plans  and  general  procedures  for  use  where  disposition  of  product  is 
made  on  a  unit-by-unit  basis  and  production/ rebuild  is  on  a  moving  line. 

m.  AR  705-5,  Army  Research  and  Development.  Specifies 
responsibilities  and  establishes  policy  and  procedures  for  conducting 
research  and  development  in  the  Department  of  Army.  These  proce¬ 
dures  are  classified  into  the  three  major  categories  of  research,  de¬ 
velopment,  and  special  instructions  pertaining  to  nuclear  energy. 
Appendixes  are  included  regarding  the  format  for  submitting  QMR's 
and  SDR '  s . 
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n .  AMCR  702-8,  Reliability  Record  and  Status  Report.  P r e  - 
scribes  policies,  procedures,  and  responsibilities  for  the  preparation 
of  quarterly  reports  on  item  reliability  throughout  the  entire  life  cycle. 

o.  4120.  3-M  (AR  715-10),  Defense  Standardization  Manual. 
Establishes  format,  and  general  instructions  for  the  preparation  of 
specifications,  standards,  handbooks,  and  maintenance  manuals. 

p.  MIL-HDBK-21  7A,  Reliability  Stress  and  Failure  Rate  Data 
for  Electronic  Equipment.  Provides  the  procedures  and  failure  rate 
data  for  the  prediction  of  part-dependent  equipment  reliability  from 
stress  analysis  of  the  parts  used  in  the  design  of  the  equipment.  Must 
be  used  according  to  procedures  outlined  in  MI1.-STD-756A  for  esti¬ 
mates  of  MTBF  and  reliability  at  the  system  level,  and  to  account  for 
tolerance  and  interaction  failures,  and  to  adjust  for  the  particular  use 
environment. 

q .  H108,  Sampling  Procedures  and  Tables  for  Life  and  Relia¬ 
bility  Testing  (Based  on  Exponential  Distribution!.  This  document 
describes  the  general  principles  and  outlines  specific  procedures  and 
applications  of  life  test  sampling  pians  for  determining  conformance 

to  established  reliability  requirements,  assuming  failure  times  to  be 
exponentially  distributed. 

r .  TR-3,  Sampling  Procedures  and  Tables  for  Life  and  Relia - 
bility  Testing  Based  on  the  Weibull  Distribution  (Mean  Life  Criterion'  ? 
Provides  procedures  and  tables  of  life  test  sampling  plans  for  deter¬ 
mining  conformance  to  established  reliability  requirements  (in  terms 
ot  mean  life)  where  the  Weibull  distribution  describes  failure  times. 

s.  TR-4,  Sampling  Procedures  and  Tables  for  Fife  and  Relia¬ 
bility  Testing  Based  on  the  W'eibull  Distribution  (Hazard  Race  Criterion) . 
Provides  procedures  and  tables  of  life  test  sampling  plans  for  deter¬ 
mining  conformance  to  established  reliability  requirements  (in  terms 

of  hazard  rate)  where  the  Weibull  distribution  describes  failure  times. 

t.  TR-6,  Sampling  Procedures  and  Tables  for  Life  and  Relia¬ 
bility  Testing  Based  on  the  Weibull  Distribution  (Reliable  Life  Criterion! 
Provide"  procedures  and  provides  tables  of  life  test  sampling  plans  for 
determining  conformance  to  established  reliability  requirements  (in 
terms  of  reliable  life)  where  the  Weibull  distribution  describes  failure 
time  s . 
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u.  TR-7,  Factors  and  Procedures  for  Applying  MIL-STD- I05D 
Sampling  Plans  to  Life  and  Reliability  Testing.^  Provides  a  procedure 
and  contains  related  tables  of  factors  for  adapting  MIL-STD -  1  05D 
sampling  plans  to  reliability  acceptance  tests.  The  underlying  distri¬ 
bution  of  failure  limes  is  assumed  to  be  Woibull. 

Section  VI.  SUMMARY 

1-10.  Elements  of  reliability  achievement,  a.  The  pursuit  and  ac¬ 
quisition  of  reliability  objectives  requires  that  management: 

(1)  Acknowledge  and  strive  to  attain  established  item 
effectiveness. 


(2)  Know  and  define  the  level  of  reliability  desired. 

(3l  Recognize  the  disparity  between  the  desired  reliability 
level  and  that  level  which  will  probably  be  achieved  unless  proper  con¬ 
trols  are  exorcised  to  influence  the  reliability  growth  process. 

(41  Understand  the  application  of  available  approaches  by 
which  controlled  reliability  growth  may  be  assured. 

b.  The  remaining  chapters  of  this  document  outline  some  of 
the  planning  considerations  and  describe  some  of  the  procedures  that 
can  be  fruitful,  both  in  the  achievement  of  required  reliability  in  speci¬ 
fic  programs  and  in  the  eval  uation  and  monitoring  of  reliability  on  a 
program-wide  basis  throughout  the  system  life  cycle. 


Final  Report  of  the  Weapon  System  Effectiveness  Industry  Advisory 
Committee  (WSEIAC).  The  documents  listed  below  are  available  from  the 
Defense  Documentation  Center,  Cameron  Station,  Alexandria,  Virginia 
22314  . 

AFSC-TR-65-1 ,  Requirements  Methodology  (AD-458453). 

AFSC-TR-65-2 ,  Prediction  Measurement  (3  volumes) 

(AD-458454,  AD-458455,  AD-458456). 

AFSC-TR-65-3 ,  Data  Collection  and  Management  Reports  (AD-458585). 
AFSC-TR-65-4 ,  Cost  Effectiveness  and  Optimization  (3  volumes) 
(AD-458595,  AD-462398,  AD-458586). 

AFSC-TR-65-5 ,  Management  Systems  (2  volumes) 

(AD-461171,  AD-461172). 

AF3C-TR-65-6 ,  Chairman's  Final  Report  (AD-467816). 

^See  footnote  1,  page  F-57. 
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CHAPTER  2 

RELIABILITY  PROGRAM  REQUIREMENTS, 
PLANNING,  AND  MANAGEMENT  GUIDE 

Section  I.  INTRODUCTION 


2-1.  General,  a.  Project  and  commodity  managers  are  charged 
with  the  responsibility  for  delivering  reliable  systems  to  the  field. 

This  responsibility  can  be  fulfilled  only  by  giving  due  consideration 
to  all  characteristics,  including  reliability,  in  the  early  planning  and 
feasibility  study  stages  and  continuing  with  a  comprehensive  program 
throughout  the  entire  materiel  life  cycle.  However,  some  programs 
do  not  provide  adequate  reliability  control  or  monitoring  prior  to  the 
operational  phase.  By  then,  it  is  usually  too  late  to  make  modifica¬ 
tions  for  improvement,  since: 

(1)  The  equipment  is  needed  now  for  operational  use  (de¬ 
velopment  time  has  been  exhausted);  and 

(2)  The  money  invested  is  too  great  to  be  written  off  because 
of  poor  reliability.  Often  it  is  considered  more  expedient  to  add  funds 
in  a  desperate  attempt  to  make  product  improvement. 

b.  This  chapter  sets  forth  reliability  program  activities  deemed 
vital  to  development  and  production  programs  in  general.  Emphasis  is 
placed  upon  reliability  program  planning,  monitoring,  and  management 
review  procedures.  Appendix  B  contains  a  network  diagram  comprised 
of  a  suggested  list  of  milestones  for  monitoring  a  reliability  program. 
Among  the  primary  purposes  of  a  reliability  program  are' 

(1)  Focusing  engineering  and  management  attention  on  the 
reliability  requirements; 

(2)  Insuring  that  reliability  is  treated  as  a  design  param¬ 
eter  of  equal  importance  with  other  effectiveness  parameters;  and 
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(3)  Alerting  management,  throughout  the  program,  to 
reliability  discrepancies  which  may  require  management  decisions. 

c.  An  adequate  program  must  contribute  to,  and  guide,  an 
orderly  and  scientific  approach  to  designing  for  reliability.  It  must 
help  contractors  and  individuals  overcome  a  lack  of  recognition  that 
reliability  must  be  a  designed-for  parameter  with  practical  limita¬ 
tions.  It  must  foster  the  realization  that  good  conventional  design  may 
not  result  in  the  inherent  reliability  required  to  satisfy  the  Army. 

d.  A  reliability  program  will  not  necessarily  increase  the 
effectiveness  of  an  equipment,  but  an  effectively  monitored  program 
will  not  permit  an  inadequate  design  to  proceed  into  development, 
test,  production,  and  field  use  without  specific  management  approval. 
It  is  this  effective  monitoring  that  assists  project  and  commodity 
managers  to  assess  and  pinpoint  potential  reliability  problems  in 
time  to  make  adjustments. 

e.  The  concept  of  a  total  reliability  program,  as  generally- 
endorsed  by  the  DoD,  has  four  major  points: 

<  1 )  Quantitative  requirements  are  stated  in  the  contract 
or  design  specifications. 

(2)  A  reliability  prog/am  is  established  by  the  contractor. 

(3)  Reliability  progress  is  monitored  or  audited  by  the 
responsible  Army  agency. 

(4)  Realistic  requirements  are  stated  in  the  Qualitative 
Materiel  Requirements  (QMR)  and  that  they  are  included  as  one  of 
the  necessary  requirements  to  be  fulfilled  for  successful  passing  of 
acceptance  tests.  This  applies  to  prototype  or  demonstration  models 
prior  to  production  approval  and  to  production  samples. 
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Section  II.  RECOMMENDED  CONTRACTOR  PROGRAM 


2-2.  Gene r al.  Of  specific  interest  is  the  reliability  program  re¬ 

quired  of  the  contractor.  Those  activities  which  experience  has  shown 
contribute  to  an  orderly  and  scientific  approach  to  designing  for  relia¬ 
bility  are  discussed  below. 

2-3.  Reliability  organization.  The  reliability  function  should  be 
an  integral  part  of  the  overall  contractor  organizational  structure. 
Considerations  for  this  function  should  include; 

a.  Proper  placement  within  the  overall  organizational  struc¬ 
ture  so  as  to  have  proper  authority  and  effectivity. 

b.  Clear  identification  of  the  personnel  responsible  for  manag¬ 
ing  the  reliability  program. 

c.  Clear  definition  of  responsibilities  and  functions  of  those 
directly  associated  with  reliability  policies  and  implementation. 

d.  Integration  of  such  functions  as  engineering,  manufacturing, 
quality,  and  reliability, 

2 - 4 .  Reliability  management,  control,  and  monitoring  activities . 

a.  Management  and  control.  The  management  of  the  reliability 
group  should  establish  policies  and  maintain  control  of  reliability  func¬ 
tions,  To  assure  these  functions,  the  reliability  program  plan  should 
include : 


(1)  Description  of  all  tasks  to  be  performed  with  a  de¬ 
tailed  list  of  specific  tasks,  including  implementation  and  control 
procedures. 

(2)  Clearly  defined  authority  and  responsibility  for  carry¬ 
ing  out  each  task. 

(3)  Schedule  of  activities  indicating  major  milestones 
(network  diagram)  and  estimates  of  manpower,  equipment,  facilities, 
time ,  and  cost. 
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(4)  A  method  for  identification,  effect  analysis,  and 
corrective  actions  for  potential  problems. 

b.  Contractor-e stablished  reliability  monitoring  activity. 

This  activity  provides  analysis  of  reliability  status  relative  to  re¬ 
quirements,  weaknesses,  and  follow-up  on  corrective  action.  Docu¬ 
mentation  of  reliability  assurance  and  monitoring  procedures,  such 
as  checklists  and  instructional  material  normally  used  by  the  con¬ 
tractor,  should  be  maintained  so  as  to  clearly  delineate  approach 
used  and  results  obtained,  and  should  be  available  for  review  by  the 
procuring  agency. 

2-5.  Program  review.  Contractor  and  procuring  agency  provisions 
for  review  of  the  reliability  program  status  should  include: 

a.  Establishment  of  major  review  points  by  procuring  agency 
at  time  of  program  planning. 

b.  Criteria  and  information  to  be  used  for  assessment  of  re¬ 
liability  progress. 

c.  Identification  of  the  responsible  group  for  carrying  out  the 
reviews . 

2-6.  Development  testing.  A  main  purpose  of  development  testing 
is  to  determine  how  well  design  reliability  requirements  have  been 
met  and  with  what  degree  of  confidence.  Among  the  considerations 
necessary  to  accomplish  this  '  s  a  planned  program,  including: 

a.  Environmental  tests  based  on  extreme  stress  conditions. 

b.  Test-related  procedures,  including  provisions  for  non- 
specified  environmental  criteria,  nonavailable  testing  data,  record 
keeping  and  a  listing  of  items  having  critically  limited  useful  life. 

2-7.  Integrating  equipment.  The  reliability  program  plan  should 
include  provisions  for  use  of  equipment  supplied  by  the  government 
or  other  contractors.  For  such  equipment,  consideration  must  be 
given  to : 
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a.  Use  of  kntnvn  or  estimated  reliability  values. 

b.  Procedures  for  getting  such  data,  if  not  available. 

c.  Procedures  for  handling  of  potential  reliability  problems 
introduced  by  such  equipment. 

2-8.  Parts  reliability  improvement.  The  reliability  plan  should 
include  procedures  for  identifying  those  parts,  if  any,  needing  im¬ 
provement  and  for  accomplishing  the  necessary  improvement.  De¬ 
ficiencies  in  MIL-Specificatior.s  u.r  inadequate  parts  resulting  from 
such  specifications  should  be  reported. 

2-9.  Critical  items.  Procedures  should  be  estab'ished  for  identify¬ 
ing  and  providing  for  critical  items.  Critical  hems  are  those: 

a.  The  failure  of  which  would  prevent  satisfactory  operation 
of  the  system  (of  which  it  is  a  part)  or  create  unwarranted  safety 
hazards ; 

b.  Which  arc  of  sufficient  complexity  to  warrant  special  pro¬ 
duction  technio.ues  cr  confols; 

c.  Which  require  special  treatment  or  handling  during  trans¬ 
port  or  storage; 

d.  Which  impose  a  heavy  maintenance  and  supply  support 
burden;  or 


e.  Which  have  a  long  production  lead  time. 

2-10.  Apportionment,  prediction,  and  mathematical  models,  a.  Meth¬ 
ods  should  be  established  for  developing  mathematical  models  based 
on  functional  analysis  for  apportionment  and  prediction  of  reliability, 

b.  These  models  often  provide  the  basis  for  periodic  analy¬ 
ses  of  reliability  achievement.  These  analyses  should  be  scheduled 
to  coincide  with  P-chnical  progress  reporting  requirements  established 
by  the  contractor  ai  d  should  consider: 
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(1)  Reliability  estimates  based  on  predictions  and  test 

data. 

(2)  The  relationship  between  present  reliability  status 
and  schedule  progress. 

(3)  The  changes  in  concepts  and  approaches  that  arc 
necessary  to  accomplish  the  contract  objective. 

(4)  The  effects  of  changes  made  in  design  and  manufactur 
ing  methods  since  the  previous  analysis. 

(5)  Criteria  for  success  and  failure,  including  partial 
successes  (degraded  operation)  and  alternative  modes  of  operation. 

(6)  Production  tolerances  and  techniques,  including 
assembly  test  and  inspection  criteria  and  test  equipment  accuracies. 

(7)  Specific  p:  blern  areas  and  recommended  alternative 

approaches. 

2-11.  Contractor  design  reviews.  Engineering  design  review  and 
evaluation  procedures  should  include  reliability  as  a  tangible  opera¬ 
tional  characteristic  of  the  equipment,  assembly  or  part  under  review 
Among  reliability  considerations  during  design  reviews  are 

a.  Review  ol  current  reliability  estimates  and  achievements 
for  each  mode  of  operation. 

b.  Review  of  potential  design  or  production  problem  areas. 

c.  Analysis  of  mode(s)  and  effect(s)  of  failure. 

d.  Identification  of  the  principal  items  inhibiting  reliability 
achievement  and  proposed  solutions. 

e.  The  effects  of  engineering  decisions  and  trade-offs  upon 
reliability  achievement. 
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f  .  Procedures  to  assure  that  rpipropriate  personnel  from 
the  reliability  organizations  participate  in  the  design  reviews. 

g.  Documentations  of  design  review  results. 

2-12,  Subcontractor  and  supplier  reliability  programs.  Provisions 
should  be  established  to  insure  that  subcontractors  and  supplier 
selection  and  performance  are  consistent  with  the  ^Liability  require¬ 
ments  of  the  contract.  The  prime  contractor  must  extend  the  scope 
of  his  reliability  program  t-  he  monitoring  and  control  of  subcon¬ 
tractors  and  suppliers.  C ;  '.derations  here  are. 

a.  Incorporation  01  reliability  requiiements  in  subcontractor 
and  supplier  procurement  documents. 

b.  Provision  for  assessment  of  reliability  progress,  includ¬ 
ing  qualification  and  acceptance  testing  of  incoming  products. 

c.  Adequate  liaison  to  insure  compatibility  among  supplier 
products  to  be  integrated  into  the  end  item. 

d.  Initial  selection  procedures  for  subcontractors  and 
suppliers,  which  considcr--in  relation  to  the  requirements- -past 
performance,  willingness  to  test  and  share  test  data,  interest  and 
response  on  feedback  of  deficiency  information,  test  philosophy, 
and  realism  of  cost  and  delivery  schedules. 

2-1*  Reliability  in  ioctrination  and  training.  Provisions  should  be 
made  to  include  reliability  in  the  basic  training  and  indoctrination  of 
personnel  with  consideration  given  to: 

a.  Purpose,  i.e.  ,  improvement  of  skills. 

b.  Skill  level  of  personnel  to  be  trained,  e.  g.  ,  manager, 
engineer,  technician  or  worker. 


c.  Methods  of  instruction. 
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2-14.  Statistical  methods.  Statistical  analysis  is  a  part  of  relia¬ 
bility  assessment  activities.  The  reliability  plan  should  fully  describe 
appropriate  statistical  techniques  and  where  in  the  life  cycle  they  are 
to  be  used. 

2-15.  Trade-off  considerations.  The  prime  purpose  of  any  hardware 
development  program  is  to  get  an  effective  item  to  the  field.  Fulfill¬ 
ment  of  this  objective  requires  that  the  reliability  plan  provide  for 
potential  trade-offs  between  reliability  and  other  disciplines,  such  as: 

a.  Maintainability . 

b.  Safety  and  human  engineering  , 

c.  Design  configuration  . 

d.  Production  . 

e.  Cost  and  schedule  . 

2-16.  Effects  of  storage,  shelf  life,  packaging,  transportation, 
handling,  and  maintenance.  Provisions  to  prevent  degrading  relia¬ 
bility  by  improper  storage,  packaging,  shipping,  handling,  and 
maintenance  of  parts,  units,  subsystems,  and  systems  should  be 
established.  The  plan  should  include  procedures  for: 

a.  Periodic  inspection  and  tests  to  determine  effects  of 
storage,  shelf  life,  packaging,  transportation,  handling,  and  main¬ 
tenance  on  the  reliability  of  the  product. 

b.  Identification  of  major  or  critical  characteristics  of 
items  which  deteriorate  with  age,  environmental  conditions,  etc. 

c.  Maintenance  or  restoration  of  equipment. 

2-17.  Manufacturing  controls  and  monitoring.  Manufacturing  con¬ 
trols  and  monitoring  are  required  to  assure  that  the  reliability  achieved 
in  design  is  sustained  during  production.  Detailed  consideration  should 
be  given  to: 
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a.  Integration  of  reliability  requirements  into  production 
process  and  production  control  specifications. 

b.  Production  environments  induced  by  handling,  transport¬ 
ing,  storage,  processing,  and  human  factors. 

c.  Quality  standards  from  incoming  piece-part  inspections. 

d.  Calibration  and  tolerance  controls  for  production,  instru¬ 
mentation,  and  toolin 

e.  Integration  of  reliability  requirements  and  acceptance 
tests  into  procurement  activities. 

f  .  Identification  and  correction  of  production  control  dis- 
c  repancie  s. 


g.  Production  change  orders  for  compliance  with  reliability 
requirements. 

h.  Life  tests  of  production  samples  to  verify  quality  standards. 

2-18.  Failure  reporting,  analysis,  and  corrective  action.  A  for¬ 
malized  system  for  the  reporting,  analysis,  correction,  and  data 
feedback  for  all  failures  should  be  a  part  of  the  contractor  reliability 
program.  A  mechanism  for  failure  data  feedback  to  engineering, 
management,  and  production  activities  in  accordance  with  contractual 
requirements  is  an  integral  part  of  such  a  program.  Complete  re¬ 
porting  provides  data  on  such  things  as  accumulated  operating  time, 
on-off  cycling,  adjustments,  replacements,  and  repairs  related  to 
each  system,  subsystem,  component,  and  critical  part.  The  analysis 
of  all  failure  reports  by  an  analysis  team  formally  designated  by 
management  determines  the  basic  or  underlying  causes  of  failures 
in  parts,  assemblies,  and  end  items.  These  results  provide  for 
assignment  of  corrective  action  and  follow-up  responsibilities. 

2-19.  Reliability  demonstration,  a.  A  plan  should  be  included  for 
demonstrating  achieved  reliability  at  specified  milestones.  A  demon¬ 
stration  plan  normally  includes: 
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(1)  Number  of  test  articles. 

(2)  Accept/reject  criteria  (or  other  quantitative  decision 

criteria). 

(3)  Confidence  levels. 

(4)  Subsystem  vs,  system  level  testing. 

(5)  Plans  for  handling  of  invalid  data. 

(6)  Duration  of  test. 

(7)  Condition  of  test. 

b.  Provisions  for  periodic  and  final  reports  of  demonstra¬ 
tion  results  as  specified  by  the  procuring  agency  are  a  necessary 
part  of  such  a  plan. 

c.  Reliability  demonstration  tests  are,  in  general,  statis¬ 
tically  designed  experiments  with  consideration  given  to  confidence 
levels  and  experimental  error.  Unless  proof  of  adequacy  can  be 
substantiated  by  other  available  data  acceptable  to  the  procuring  ac¬ 
tivity,  all  items  of  equipment  of  higher  order  designations  should  be 
tested  in  order  to  verify  that  reliability  is  achievable  with  the  pro¬ 
posed  design.  If  it  is  not,  problem  areas  which  prevent  its  attainment 
should  be  isolated  and  defined.  The  test  program  should  include  tests 
of  questionable  areas  where  reliability  experience  is  not  available, 
particularly  new  or  unique  concepts,  materials,  and  environments. 

d.  The  extent  of  the  test  program  is  determined  by  weighing 
the  cost  of  testing  against  the  degree  of  assurance  required  that  the 
product  will  have  a  given  level  of  reliability. 

e.  In  addition  to  those  tests  performed  specifically  for  re¬ 
liability  demonstration,  all  formally  planned  and  documented  tests 
which  are  performed  throughout  the  contract  period  should  be  evaluated 
from  a  reliability  viewpoint  to  maximize  the  data  return  per  test  dollar. 
Data  which  are  obtained  should  facilitate  prediction  of  reliability  on  the 
basis  of  individual  and  accumulated  test  results  and  the  determination 
of  performance  variabilities  and  instabilities  that  are  induced  by  time 
and  stress. 
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Section  III.  PROGRAM  MANAGEMENT  AMD  MONITORING 


2-20.  Program  implementation.  Effective  implementation  requires 
that  both  the  procuring  agency  and  the  contractor  fulfill  obligations 
and  responsibilities  in  a  cooperative  framework  toward  the  common 
objective  of  reliable  equipment  in  the  field.  The  following  steps  are 
presented  as  a  guide  in  this  implementation. 

a.  Step  1:  Specify  reliability  requirements.  The  procuring 
agency  should  state  the  reliability  requirements  in  design  specifica¬ 
tions  or  procurement  documents  (including  Requests  for  Proposals). 
Format  and  details  for  including  the  requirements  as  part  of  the  speci¬ 
fication  are  provided  in  Defense  Standardization  Manual  4120.  3-M 

(AR  715-10)  and  appendix  C  of  this  document. 

b.  Step  2:  Establish  schedules.  The  procuring  agency  should 
establish  schedules  for  reliability  reporting  and  monitoring,  to  include: 

(1)  Reliability  report(s).  Delivery  dates  for  such  reports 
may  be  specified  on  either  a  calendar  or  a  program -phase  basis. 

(2)  Test  plans.  The  detailed  test  plan  should  be  submitted 
well  in  advance  ot  test  initiation  in  order  to  allow  sufficient  time  for 
Army  review  and  approval. 

(3)  Progress  evaluation  schedule.  Progress  evaluations 
for  effective  monitoring  are  scheduled  to  correspond  with  major  mile¬ 
stones  rather  than  at  fixed  time  intervals. 

c.  Step  3:  Prepare  Request  for  Proposal  (RFP).  The  pro¬ 
curing  agency  should  include  desired  proposal  coverage  of  reliability 
in  the  Request  for  Proposal.  A  clause  similar  to  the  following,  in¬ 
serted  in  the  RFP,  aids  in  obtaining  desired  reliability:  Proposals 
responsive  to  this  RFP  shall,  in  addition  to  the  requirements  listed 
in  MIL-STD-785,  contain  the  following: 

(1)  A  narrative  of  the  contractor's  interpretation  of  the 
requirements  to  demonstrate  that  the  requirements  are  understood. 
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(2)  Proposed  technical  and  management  approach 
toward  achievement  v/ithin  the  stated  or  implied  limitations  (if  the 
bidder  deems  the  requirement  unrealistic,  that  which  he  considers 
realistic  and  achievable  should  be  stated). 

(3)  Supporting  evidence  for  the  above,  including  re¬ 
liability  predictions  of  the  proposed  concept  end  approach;  source 
and  applicability  of  data;  experience  of  bidder  with  similar  programs; 
specific  ways  and  means  of  attainment;  assumptions  and  noncontrollable 
dependencies  upon  which  the  approach  is  based. 

(4)  Description  of  the  proposed  reliability  program, 
including  specific  technical  activities;  responsibilities  and  authorities 
within  the  proposed  organizational  structure  (including  list  of  key 
personnel,  together  with  background  and  experience);  proposed 
schedule  of  reliability  activities;  recommended  monitoring  points 
and  major  milestones  (including  cost  milestones);  and  proposed  re¬ 
liability  development  test  program.  '' 

d.  Step  4;  Prepare  proposal.  The  prospective  contractor 
should  prepare  a  proposal  in  response  to  the  RFP.  Specifically ,  the 
proposing  contractor  should; 

(1)  Analyze  the  reliability  requirements  and  make  a 
preliminary  prediction  to  determine  feasibility  for  a  given  time  and 
cost. 

(2)  Establish  and  cost  the  reliability  activities  and 
integrate  them  into  the  total  program. 

(3)  Schedule  in-house  reliability  activities  and  monitor¬ 
ing  which  become  part  of  the  master  schedule. 

(4)  Plan  development  reliability  tests.  The  contractor 
should  evaluate  the  design  approach  and  planned  developments  to 
determine  which  assemblies  and  components  will  require  test 
demonstration. 

(5)  Prepare  his  total  reliability  plan. 
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e.  Step  5:  Evaluate  proposals.  (1)  The  procuring  agency 
should  evaluate  proposals  for  their  response  to  the  specific  task  re¬ 
quirement  in  source  selection  evaluation  p  rocetiures. 

(2)  The  proposal  review  should  give  particular  attention 
to  specific  proposed  reliability  activities  rather  than  stress  the  con¬ 
tractor's  organizational  structure. 

(3)  Figures  2-1. a,  2-1. b  and  2-1. c  provide  guidance 
for  evaluating  proposals  with  respect  to  reliability. 

f.  Step  6;  Review  contractual  documents.  The  procuring 
agency  should  review  contractual  documents  prior  to  contract  negotia¬ 
tion.  Changes  in  the  reliability  requirements,  program,  or  acceptance 
tests  that  are  recommended  in  the  proposal  submitted  by  the  success¬ 
ful  bidder  must  be  reflected  in  the  design  specifications,  references, 
or  contractual  documents.  When  the  recommendations  are  not  ac¬ 
cepted,  the  prospective  contractor  should  be  notified  early  in  the 
negotiation  period  in  order  that  his  cost  and  time  estimates  may  be 
adjusted  prior  to  final  negotiation. 

g.  Stop  7:  Implement  reliability  program  in  development 
contract.  Both  contractor  and  procuring  agency  should  implement 
and  monitor  the  reliability  program  during  design  and  development. 

The  contractor  is  committed  to  perform  in  accordance  with  the  speci¬ 
fications  in  the  contractual  documents.  The  milestones  of  appendix  3 
provide  a  guide  for  monitoring  a  reliability  program. 

h.  Step  8:  Implement  reliability  program  in  production.  Im¬ 
plementation  and  monitoring  of  the  reliability  program  during  produc¬ 
tion  is  a  key  step.  A  suggested  list  of  review  points  is  provided  by 
the  milestones  in  appendix  B.  Reliability  records  should  include: 

(1)  Design  changes  in  order  to  insure  that  each  produc¬ 
tion  engineering  and  design  change  is  given  the  same  reliability 
considerations  and  approvals  as  the  original  design. 
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(2)  Procurement  of  parts  and  assemblies  in  accordance 
with  appropriate  reliability  requirements. 

(3)  Evidence  that  each  step  in  the  production  process 
has  been  evaluated  for  its  possible  detrimental  effect  upon  reliability. 

(4)  Effectiveness  of  production  inspections  and  collection, 
analysis,  and  feedback  of  test  data  in  maintaining  design  quality. 

(5)  Summaries  of  qualification,  environmental,  and 
other  test  data. 

(6)  Compliance  with  the  production  acceptance  tests 
requirements . 
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REQUIREMENTS  ANALYSIS 

Is  the  reliability  requirement  treated  as  a  design 
parameter? 

Has  the  requirement  been  analyzed  in  relation  to  the 
proposed  design  approach? 

Is  there  a  specific  statement  that  the  requirement  is,  or  is 
not,  feasible  within  the  time  and  costs  quoted?  If  not 
feasible,  is  an  alternative  recommended? 

Is  there  evidence  in  the  proposal  that  the  reliability  re¬ 
quirement  influenced  the  cost  and  time  estimates0 

Are  initial  predictions  and  apportionments  included  in 
sufficient  detail  (data  sources,  complexity,  block  diagram, 
etc.  )  to  permit  Army  evaluation  of  its  realism? 

Are  potential  problem  areas  and  unknown  areas  discussed'5 
Or,  if  none  are  anticipated,  is  this  so  stated? 

If  the  requirement  is  beyond  that  which  presently  can  be 
achieved  through  conventional  design,  does  the  proposal 
describe  how  and  where  improvements  will  be  accomplished? 

Is  consideration  given  to  conducting  trade-offs  between 
reliability  and  other  technical  parameters? 

RELIABILITY  PROGRAM  AND  MONITORING 

Does  the  proposed  program  satisfy  the  requirements  of 
the  REP? 

If  the  contractor  has  indicated  that  certain  of  the  reliability 
activities  requested  are  not  acceptable  to  him,  has  he 
suggested  satisfactory  alternatives9 


Figure  2-1. a 

Proposal  Evaluation  Guide 
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RELIABILITY  PROGRAM  AND  MONITORING 
(continued ) 

Is  the  program  specifically  oriented  to  the  anticipated  needs 
of  the  proposed  equipment?  Is  it  in  sufficient  detail? 

Are  program  activities  defined  in  terms  of  functions  and 
accomplishments  relating  to  the  proposed  equipment? 

Does  the  proposal  include  planned  assignment  of  responsi¬ 
bilities  for  reliability  program  accomplishments? 

Is  it  clear  by  what  means  the  program  may  influence  de¬ 
velopment  of  the  proposed  equipment? 

Have  internal  '  independent"  reliability  assessments  been 
scheduled? 

Does  the  proposal  provide  justification  (data  derived  from 
testing  or  other  experience)  for  the  exclusion  of  specified 
items  from  demonstration  testing0 

Is  the  proposed  documentation  of  activities,  events,  and 
analyses  designed  for  ease  in  monitoring,  ease  of  data 
retrieval,  and  use  on  future  programs9 

Are  planned  activities  and  events  scheduled  and  docu¬ 
mented? 

Does  the  proposal  include  a  controlled  corrective  action 
program  for  reliability  data? 


r igure  2  -  1 . b 

Proposal  Evaluation  Guide 
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BACKGROUND  ORGANIZATION  AND  EXPERIENCE 

Does  the  bidder  have  an  established  program  whereby  past 
experience  is  made  available  to  engineers  and  designers? 

Does  the  bidder  have  a  designated  group  (or  individual)  to 
whom  designers  can  turn  for  technical  reliability  assistance? 

Does  the  assignment  of  responsibilities  include  reliability 
activities  ? 

Do  (or  will)  company  standards  manuals  or  other  documents 
set  forth  standard  reliability  operating  procedures? 

Does  the  bidder  provide  for  appropriate  reliability  training 
for  management,  engineering,  and  technical  personnel? 

Does  the  bidder  implement  and  conduct  planned  research 
programs  in  support  of  line  activities,  seeking  new  materi- 
els,  newr  techniques,  or  improved  analytical  methods? 

ACCEPTANCE  TESTING 

Has  the  bidder  agreed  to  perform  acceptance  tests  and 
included  the  costs  and  time  within  his  proposal? 

If  acceptance  test  plans  were  not  included  in  the  request  for 
proposal,  has  the  bidder  recommended  any? 

Does  the  proposal  contain  a  positive  statement  concerning 
the  bidder's  liability  in  the  event  of  rejection  by  the  accept¬ 
ance  tests? 


Figure  2  -  1.  c 

Proposal  Evaluation  Guide 
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Section  IV.  RELIABILITY  TRAINING 

2-21.  General,  a.  The  concept  of  reliability  in  system  develop¬ 
ment  is  not  new.  Only  a  few  of  the  fundamental  principles  need  be 
understood  by  project  management  and  engineering  in  order  to  put 
quantitative  measurements  on  this  system  parameter.  It  is  true 
that  the  complexities  of  redundancy,  statistical  test  design,  sampling, 
and  many  other  aspects  of  reli  bility  assessment  arc  difficult  con¬ 
cepts,  and  an  effective  training  program  must  include  consideration 
of  all  levels  of  personnel  involved  with  the  reliability  program.  The 
technical  content  of  a  training  course  must  be  tailored  to  the  person¬ 
nel  to  be  trained;  e.g.,  a  survey  course  for  management  and  detailed 
technique  courses  for  engineers  and  technical  personnel. 

b.  The  training  problem  is  to  prepare  and  present  highly 
practical  c  trses  in  the  fundamentals  of  reliability,  tailored  to  fit 
the  needs  o.  individual  groups  within  the  Army.  Thus,  the  course 
must  be  dynamic  in  its  flexibility  and  adaptability.  It  must  be  well 
documented  with  examples  and  "tools  of  the  trade." 

c.  Training  courses  available  at  DoD  schools  and  private 
schools  and  conferences  sponsored  by  various  technical  societies 
provide  valuable  means  of  meeting  training  needs  at  minimum  cost. 

2-22.  Guidelines.  Ideal  training  activities  include  classi  n  instruc¬ 
tion,  supplemented  by  on-the-job  application  of  the  subject  materials. 
The  following  questions  are  helpful  in  planning  or  selecting  training 
courses.  Do  they: 

a.  Reflect  the  needs  of  attendees  in  terms  of  the  scope  of 
the  course  to  be  presented7 

b.  Include  separate  training  programs  and  materials  to 
specifically  meet  the  needs  of  management  and  technical  personnel7 

c.  Include  management  practices  and  engineering  methods 
utilized  throughout  the  entire  life  cycle7 


t 
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2-23.  Course  content.  The  following  suggested  course  outline  can 
be  adapted  to  specific  needs  drawing  on  appropriate  sections  of  this 
document. 


a.  What  should  be  known  about  basic  concepts  of  reliability 
as  a  measurable  product  characteristic?  How.  for  exajnple,  do  you: 

(1)  Define  characteristics  for  specific  equipments? 

(2)  Graphically  and  mathematically  visualize  these 
char  acteri  otic  s? 

(3)  Express  reliability  in  terms  of  confidence  statements? 

b.  What  should  be  known  about  specifications  pertaining  to 
reliability?  How  do  you: 

(1)  Determine  reliability  requirements  for  parts,  equip¬ 
ments,  and  systems’ 

(2)  Specify  the  requirements? 

(3)  Specify  tests  for  compliance  with  given  confidence 

levels  ? 

c.  What  should  be  known  about  reliability  as  an  engineering 
function?  How  do  you 

(1)  Predict  reliability  feasibility  of  new  design  concepts? 

(2)  Predict  reliability  achievement  during  the  develop¬ 
ment  phase  ? 

(3)  Evaluate  the  described  reliability  problem  areas  for 
correction  in  early  de.'ign’ 

d.  What  should  be  known  about  reliability  assurance?  How 

do  you 
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(L)  Control  reliability' 

(2)  Demonstrate  reliability  achievement? 

e.  How  do  you  review  and  develop  specific  equipment  and 
system  program  plans  and  specifications?  Include: 

(1)  Program  requirements, 

(2)  Quality  assurance  provisions  for  reliability. 

f.  How  do  you  review  development  status  of  specific  systems? 

Include 

(1)  Reliability  appo  rtionment. 

(2)  Problem  areas. 

g.  V/hat  should  be  known  about  contractor  reliability  pro¬ 
grams0  How  do  you 

(1)  Evaluate  a  program' 

(2)  Specify  program  requirements0 

(3)  Monitor  contractor  programs  for  compliance? 

h.  What  should  be  known  about  reliability  monitoring  and 
failure  diagnosi  s : 

(1)  In  design,  development,  production,  and  field  use? 

(2)  To  assure  earliest  practicable  correction'.' 

i.  W'hat  specific  steps  can  you  take  to  assure  higher  relia¬ 
bility  in  systems?  These  include  review  of: 

(!)  Requirements  analysis  and  specifications. 

(2)  Demonstration  and  acceptance. 
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(3)  Procurement  documentation. 

(4)  Monitoring  and  follow-up  (including  feedback). 
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CHAPTER  3 

TECHNICAL  REQUIREMENTS  ANALYSIS  AND  DOCUMENTATION 
OF  RELIABILE  (  REQUIREMENTS 

Section  I.  INTRODUCTION 

3-1.  General,  a.  Early  system  development  plans  are  not  complete 
if  they  do  not  quantitatively  define  the  required  characteristics  of  the 
product  or  system  proposed  for  development.  While  in  the  past  the 
characteristics  of  a  new  equipment  or  system  have  been  adequate  to 
guide  development  effort  toward  full  realization  of  performance  require¬ 
ments,  they  often  have  not  been  sufficiently  descriptive  of  the  reliability 
characteristics  required  for  system  success  under  field  use  conditions. 
These  important  success  characteristics  must  be  planned  for  and  design¬ 
ed  into  the  system.  They  cannot  be  added  as  an  afterthought.  This 
chapter  outlines  procedures  for  the  definition  and  documentation  of 
reliability  requirements  in  essential  planning  documents,  specifications 
and  contractual  task  statements. 

b.  The  problem  is  one  of  first  stating  system  requirements  for 
reliability  in  the  Qualitative  Materiel  Requirements  (QMR).  These  con¬ 
stitute  the  basis  for  the  preparation  of  the  Technical  Development  Plan 
(TDP)  to  accomplish  CDC  objectives.  Required  is  the  definition  and 
documentation  of  requirements  in  the  TDP  and  the  definition  baseline 
in  order  to  give  the  system  concept  a  clean  entry  into  its  development 
cycle.  This  is  intended  to  insure  ihat  an  ope  rationally  suitable  system 
evolves  as  a  result  of  good  planning  followed  by  effective  pursuit  of 
planned  objectives. 

Section  II.  CONTENTS  OF  QMR'S  and  SDR'S 

3-2.  General,  a.  Among  the  most  important  phases  of  the  system  life 
cycle  are  the  concept  and  definition  phases,  where  system  requirements 
are  analyzed  and  translated  into  well-defined  technical  objecti  res  and 
detailed  plans  are  laid  to  assure  successful  achievement  of  these 
objectives. 
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b.  In  general,  there  are  three  closely  related  analyses  required 
in  order  to  generate  the  essential  descriptive  information  needed  for 
preparation  of  technical  development  plans,  design  specifications,  re¬ 
quest  for  proposals,  and  contractual  task  statements.  These  are: 

(1)  Analysis  and  definition  of  the  operational  requirements  -- 
performance,  reliability,  and  maintainability  --  necessary  for  the  de¬ 
sired  level  of  system  effectiveness. 

(2)  Prediction  of  the  feasibility  of  achieving  these  require¬ 
ments  by  conventional  design  in  order  to  assess  the  practical  difficulty 
of  the  development  job. 

(3)  An  equitable  method  of  initial  apportionment  (allocation) 
of  requirements  and  supporting  R&D  effort  among  subsystems. 

c.  The  last  two  of  these  analyses  are  discussed  in  chapter  4.  The 
first  is  discussed  in  this  section.  It  pertains  to  the  formulation  of  a 
QMR/SDR  based  upon  national  defense  objectives,  intelligence  estimates, 
and  concept  or  feasibility  studies  which  determine  the  requirements  for 

a  new  capability  and  the  need  for  a  new  item.  The  QMR/SDR  expresses 
Department  of  Army  requirements  for  new  equipment  or  for  major 
innovations  or  improvements  related  to  research  and  development  as 
developed  from  new  concepts. 

d.  The  QMR  is  a  Department  of  Army  approved  statement  of  a 
military  need  for  a  new  item,  system  or  assemblage,  the  development 
of  which  is  believed  feasible,  and  is  directed  toward  attainment  of  new 
or  substantially  improved  materiel.  It  is  stated  at  the  earliest  time 
after  the  need  is  recognized  and  feasibility  of  development  has  been 
determined. 

e.  The  SDR  is  used  to  state  a  DA  need  for  development  of  equipment 
of  proven  feasibility  which  can  be  developed  with  less  effort.  Because 

of  low  cost  and  simplicity  of  development,  such  equipment  does  not 
warrant  the  establishment  of  a  QMR, 

f.  The  QMR/SDR  goes  through  four  stages  before  final  approval 
is  given.  These  are: 
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(1)  Initial  draft  proposed  QMR/SDR  . 

(2)  Draft  proposed  QMR/SDR. 

(3)  Proposed  QMR/SDR  . 

(41  Department  of  Army  approved  QMR/SDR  . 

3-3.  Reliability  information  in  QMR's  and  SDR's.  a.  Reliability 
requirements  should  be  stated  in  terms  appropriate  to  the  item  con¬ 
sidering  its  intended  purpose,  its  complexity,  and  the  quantity  ex¬ 
pected  to  be  produced.  In  addition,  these  requirements  must  be  clear, 
quantitative,  and  capable  of  being  measured,  tested  for,  or  otherwise 
verified.  QMR's/SDR's  must  include  detailed  essential  reliability  re¬ 
quirements.  Statistical  confidence  levels  and  risks  associated  with 
demonstrating  achievement  of  these  requirements  are  to  be  stated  in 
documents  describing  test  requirements,  but  not  in  the  QMR  or  SDR. 
Specifically ,  the  information  to  be  included  in  requirements  is  as 
follows : 


(1)  Reliability.  The  overall  reliability  requirement 
must  be  quantitatively  expressed  as  a  probability  of  success  for  one 
(or  morel  specified  operational  and  environmental  cycle(s)  or  func¬ 
tional  soquence(s).  Reliability  may  be  apportioned  for  major  phases 
of  the  mission.  When  an  operational  profile  is  riot  well  defined  (e.  g.  , 
continuous  operation',  the  closely  related  attribute,  MTBF,  maybe 
specified  instead  of  probability  ol  success.  Normally,  one  or  the 
other  attribute,  but  not  both,  is  specified.  Reliability  requirements 
should  be  stated  for  two  or  more  operational  profiles,  if  appropriate. 

(2!  Reliability  after  storage.  This  must  be  specified  so 
as  to  indicate  the  amount  of  deterioration  which  can  be  tolerated  dur¬ 
ing  storage.  Length  of  storage,  storage  environment,  and  surveil¬ 
lance  constraints  should  be  identified  for  planning  purposes. 

b.  Of  the  above  requirements,  only  those  that  are  appropriate 
for  the  item  or  equipment  in  question  should  be  used.  A  more  derailed 
discussion  with  examples  of  how  the  above  requirements  are  to  be 
slated  in  QMR's/SDR's  is  given  in  appendix  C. 
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c.  The  discussions  in  this  section  represent  an  approach  to 
determination  of  feasible  requirements  of  the  proposed  system.  Quan¬ 
tification  of  the  above  elements  provides  input  for  the  development  of 
realistic  and  meaningful  contractual  documents  and  specifications. 

Sec-ion  III.  DOCUMENTATION  OF  RELIABILITY  REQUIREMENTS 
IN  TECHNICAL  DEVELOPMENT  PLANS  (TDP's) 

3 - 4 .  Role  of  the  TDP  and  the  research  and  technology  resume  in  sys¬ 

tem  development.  The  technical  development  plan  (TDP)  is  expected 
to  outline  plans  for  development  and  provide  guidance,  goals,  and  speci¬ 
fic  direction  necessary  to  assure  that  effectiveness  will  be  achieved. 

The  inclusion  of  statements  delineating  performance,  reliability,  and 
maintainability  in  TDP's  is  aimed  at  this  goal.  The  TDP  is  applicable 
to  those  major  development  projects  and  tasks  selected  by  the  Chief 
of  Research  and  Development  and  announced  by  separate  correspond¬ 
ence.  In  order  that  the  Army  Research,  Development,  Test,  and 
Evaluation  (RDTE)  Program  be  extended  to  all  major  equipment,  the 
Research  and  Technology  Resume  (DD  Form  1498',  applies  to  projects 
not  covered  by  TDP's. 

3-5.  TDP  format.  In  order  to  highlight  the  existence  and  adequacy 
of  a  reliability  program,  a  separate  section  is  included  in  the  TDP 
for  this  program.  An  outline  of  the  TDP  format  is  shown  in  figure  3-1. 
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3-6.  Documentation  of  reliability  in  TDP's.  a.  Each  TDP  must 
include  information  on  the  reliability  program  for  that  project  and 
on  the  interface  of  these  characteristics  with  other  characteric  ics, 
as  follows: 

(1)  Information  listed  in  QMR's/SDR 's. 

(2)  The  plan  for  achieving  reliability  goals. 

(3)  The  plan  for  conducting  the  reliability  program. 

(4)  Reliability  inputs  to  the  costs  and  scheduling  portions 
of  the  development  plan. 

(5)  The  plan  for  life  cycle  assessment  of  reliability 
characteristics. 

(6)  The  plan  for  development  of  compatibility  with  multi¬ 
purpose  maintenance  equipment  and  of  system  peculiar  maintenance 
equipment. 

b.  Information  contained  in  development  plans  is  expected 
to  be  more  detriled  than  that  normally  found  in  objective  s  /  require - 
ments  documents  (e.  g.  ,  OMR);  therefore,  direct  extracts  from 
QMR's  are  no,  adequate.  In  those  instances  where  the  development 
plan  is  preliminary,  listing  of  significant  elements  without  detail  will 
suffice;  e.g.,  the  fact  th?t  apportionment  and  prediction  will  be  part 
o£  the  program.  Subsequent  revisions  must  become  increasingly  more 
explicit  and  detailed,  and  must  include  updated  reliability  status  in¬ 
formation  for  comparison  with  requirements. 

Section  IV.  DOCUMENTATION  OF  RELIABILITY  REQUIREMENTS 
IN  PROCUREMENT  DOCUMENTS  AND  SPECIFICATIONS 

3-7.  General,  a.  The  specification  is,  "...  a  document  intended 
primarily  for  use  in  procurement,  which  clearly  and  accurately  de¬ 
scribes  the  essential  and  technical  requirements  for  items,  materials, 
or  servi  is  including  the  procedures  by  which  it  will  be  determined 
that  the  requirements  have  been  met.  "  (Defense  Standardization 
Manual  4120.  3-M  (AR  715-10)] 


3- 


AMCP  702-  3 


b.  Reliability  specification  requirements  consist  of  three 
distinct  but  related  areas  of  coverage: 

(1)  Detailed  quantitative  requirements. 

(2)  General  program  requirements. 

(3)  Quality  assurance  provisions  (Test  and  Evaluation 
Requirements). 

c.  These  three  areas  may  be  included  in  the  overall  design 
specification  for  a  product  (Method  A)  or  covered  under  a  separate 
reliability  specification  (Method  B). 

(1)  Method  A.  Integrated  specifications:  Reliability 
as  a  design  parameter  is  logically  specified  in  section  III  of  the  de¬ 
sign  specification  (both  detailed  and  general  coverage)  and  the 
quality  assurance  provisions  integrated  into  the  overall  provisions 
of  section  IV  . 

(2)  Method  B.  Separate  specifications :  This  alterna¬ 
tive  is  recommended  only  when  clarity  and  simplicity  can  be  greatly 
enhanced.  A  reliability  specification  must  follow  approved  specifica¬ 
tion  format,  consisting  of  the  following. 

(a)  Scope. 

(b)  Applicable  documents. 

(c)  Requirements. 

(d!  Quality  assurance  provisions  (Test  and  Evalua¬ 
tion  Requirements). 

(e)  Preparation  for  delivery. 

(f  )  Notes. 
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3-8.  Types  of  documents  and  specifications  required.  In  order  to 
maintain  control  throughout  the  materiel  life  cycle,  it  is  necessary  to 
have  a  given  plan  which  requires  documentation  of  item  requirements. 
Throughout  AMC,  control  is  accomplished  by  means  of  the  concept 
known  as  configuration  management  in  conjunction  with  project  man¬ 
agement  or  commodity  management  (see  AMCR  11-26). 

3-9.  Essential  reliability  features  of  specifications,  a.  The  con¬ 
tent  of  military  specifications  is  prescribed  in  Defense  Standardization  Manual 
4120.  3-M.  Important  features  of  the  specifications  are  the  numerical 
requirements  for  equipment  characteristics  and  the  compliance  require¬ 
ments.  These  arc  given,  respectively,  in  the  sections  labeled  Re¬ 
quirements  and  Quality  Assurance  Provisions  (Test  and  Evaluation 
Requirements ) . 

b.  Basically,  the  section  of  the  specification  outlining  re¬ 
quirements  for  system  and/or  development  descriptions  contains 
performance  and  design  requirements.  Requirements  for  the  test 
and  evaluation  methods  to  be  used  to  check  on  conformance  with  ihese 
requirements  are  stated  separately, 

(1)  The  introductory  paragraph  consists  of  descriptive 
and  introductory  material,  while  quantitative  requirements  are  stated 
and  explained  in  detail  as  separate  parts  of  the  section.  The  paragraph 
specifying  reliability  requirements  must  bo  in  agreement  with  those 
stated  in  the  QMR/SDR  and  TDP  and  must  be  in  quantitative  terms. 

In  order  to  assure  that  these  reliability  requirements  are  properly 
specified,  system  operational  requirements,  use  conditions,  the  time 
measure  or  mission  profile,  reliability  design  objectives,  quantita¬ 
tive  reliability  requirements,  and  reliability  program  requirements 
should  be  considered  as  sources  of  information  for  preparing  the 
specifications . 


(a)  System  operational  requirements.  Reliability 
is  a  system  characteristic  in  the  same  sense  that  speed,  range,  and 
maneuverability  are  system  characteristics.  To  hav,  full  understand¬ 
ing  of  the  reliability  requirement,  operational  requirements  expressed 
in  QMR's  and  TCP's  must  be  described  as  well.  The  description  pro¬ 
vides  a  dividing  line  between  what  constitutes  satisfactory  and  unsatis¬ 
factory  equipment.  To  clearly  make  this  distinction,  it  is  necessary 
to  include  both  design  objectives  and  minimum  acceptable  values  as  a 
lower  tolerance*  limit  on  the  performance  parameter. 
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Example:  A  radar  do sign  specification  may  desire  iho  system  to 
detect  i  sq.  meter  targets  at  300,  000  meters.  The  quantitative 
requirement  might  be  stated  as  follows:  The  dosi-  .  objective  shall 
be  let  detect  ]  sq.  meter  targets  at  300,000  meters.  The  system 
shall  bo  considered  unacceptable  if  1  sq.  meter  targets  are  not  de¬ 
tected  at  225,000  meters. 

(b l  Use  conditions.  The  conditions  under  which 
the  item  must  perform  should  be  stated  in  standard  terminology. 

Use  conditions  refer  to  those  conditions  under  which  specified  re¬ 
liability  is  to  be  obtained,  including  temperature,  humidity,  shock, 
vibration,  pressure,  penetration/ abrasion,  ambient  light,  mount¬ 
ing  position,  weather  (wind,  rain,  snow),  operator  skills  and  other 
conditions  covered  in  AR  705-  1  5,  Operation  of  Equipment  Under 
Extreme  Conditions  of  Environment.  In  order  to  prevent  undue 
equipment  costs,  stated  use  conditions  should  not  be  overly  strin¬ 
gent,  nor  should  unnecessary  conditions  be  specify  d  for  equipment 
which  will  be  used  under  controlled  or  limited  climatic  conditions. 
Use  conditions  are  stated  in  both  narrative  and  specific  formats, 
with  mission  profiles  included  where  environmental  changes  are 
expected  through  the  operating  period. 

Example:  Narrative.  The  XXX  Tractor  must  be  capable  of  operat¬ 
ing  as  specified  in  climatic  and  weather  conditions  ranging  from 
temperate  to  arctic  and  must  be  resistant  to  fungus,  humidity, 
water,  condensation,  and  icing. 

Example:  Specific.  The  XXX  Tractor  must  opera  c  as  specified 
under  any  or  all  of  the  following  environmental  conditions:  tem¬ 
perature,  -65°  F.  to  160°  F.  ;  humidity,  up  to  100 'Ip  and  water 
depth,  traverse  up  to  3  feet. 

Example:  Mission  Profile.  The  ABC  system  shall  meet  its  per¬ 
formance  requirements  when  subjected  to  a  mission  temperature 
profile  similar  to  that  shown  in  figure  3-2. 
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TEMPERATURE,  °C 


TIME 


Figure  3-2 

Mission  Temperature  Profile 

(c)  Time  measure.  System  usage,  from  a  time  stand¬ 
point,  plays  a  large  part  in  determining  the  form  of  the  reliability  ex- 
oression.  Figure  3-3  is  a  representation  of  a  typical  operational  se- 
'  nr"  in  those  casta  where  a  system  is  not  ea  tor  continuous 

operation,  total  anticipated  time  profile  or  time  sequences  of  operation 
should  be  defined  either  in  terms  of  duty  cycLes  or  profile  charts. 

Example:  The  mission  reliability  for  the  "x"  missile  fire  control  sys¬ 
tem  shall  be  at  least  0.  9  for  a  6-hour  mission  having  the  typical  opera¬ 
tional  sequence  illustrated  in  figure  3-3. 
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STANDBY  TIME 
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POST-OPERATION  CHECK 


Figure  3-3 

iypical  Operational  Sequence  for 
Missile  Fire  Control  System 


Reliability  design  objectives  and  requirements 
The  specific  functions  for  which  reliability  improvement  is  sought  ’ 
should  be  clearly  spelled  out.  It  is  desirable  that  both  the  specific 
functions  to  be  improved  and  the  nature  and  extent  of  the  improvement 
be  described  in  enough  detail  that  prospective  designers  have  the  ad¬ 
vantage  of  earlier  feasibility  analysis. 
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Example:  An  improvement  in  the  firing  reliability  of  the  XXX  Howitzer 
is  sought  as  a  design  objective.  Specifically,  it  shall  be  the  objective 
to  reduce  stoppages  resulting  from  faulty  extraction  of  cartridge  cases 
from  1  per  10,000  to  1  per  50,000  rounds. 

(e)  Quantitative  reliability  requirements.  _1_-  The 
specific  values  of  reliability  on  which  the  success  of  the  conceptual 
system  is  based  should  be  quantitatively  defined  at  one  or  more  points 
to  establish  the  desired  reliability  characteristics.  Four  common  ways  1 

of  defining  reliability  requirements  are:  mean  time  between  failures 
(MTBF);  probability  of  survival  for  a  specified  mission  time;  failure 
rate  over  a  specified  period  of  time;  and  probability  of  success,  inde¬ 
pendent  of  time.  Further  discussion  of  these  and  other  methods  are  j 

included  in  chapter  1  and  appendix  A. 

Example:  A  complex  radar  has  both  search  and  .rack  functions.  Ii  is  j 

also  possible  to  operate  the  search  function  in  both  a  low  and  a  high 
power  mode.  The  reliability  requirements  for  this  system  may  be  ex¬ 
pressed  as:  "The  reliability  requirements  for  this  system  shall  be  at 
least:  Case  i,  high  power  search,  28  hours  MTBF;  Case  II,  low  power 
search,  40  hours  MTBF;  and  Case  III,  track,  0.  98  probability  of  satis¬ 
factory  performance  for  1/2  hour.  "  The  definition  of  satisfactory  per-  « 

formance  must  include  limits  for  each  case.  This  can  be  conveniently 
tabulated  for  inclusion  in  the  specification.  A  sample  of  the  satisfactory 
performance  table  for  the  radar  is  shown  as  figure  3-4.  / 


System 

Performance  Limits 

Characteristic 

Units 

Case  1 

Case  2 

Case  3 

Tange 

Mete  r  s 

3^,  U00 

120, 000 

120, 000 

[Resolution  -  Range 

Meters 

+  50 

+  50 

+  10 

m/Sec. 

+  100 

+  100 

±  25 

Figure  3-4 

Satisfactory  Performance  Limits 
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_2.  The  specified  reliability  requirement  should 
also  be  defined  in  terms  of  nominal  or  minimum  values.  This  can  be 
done  by  either  identifying  a  NOMINAL  value  with  which  the  user  would 
be  satisfied,  along  with  a  minimum  that  must  be  exceeded,  or  simply 
a  MINIMUM  value  below  which  the  user  would  find  the  system  unac¬ 
ceptable. 


(f )  Reliability  program  requirements.  1.  The 
characteristics  of  the  proposed  program  should  be  described  in  such 
a  way  that  the  fulfilling  of  these  requirements  will  provide  for  con¬ 
trols  and  decision  points  necessary  to  assure  the  development  of  an 
item  which  will  meet  desired  reliability  requirements.  For  discussion 
of  reliability  programs,  see  chapter  2. 

2,.  in  the  requiring  of  a  reliability  program,  the 
following  points  should  be  kept  in  mind: 

a  Do  not  expect  a  reliability  program  to 
provide  unlimited  reliability.  On  the  contrary,  expect  the  program 
to  provide  realistic  appraisals  of  progress,  status,  and  potential  cf 
the  overall  program. 


b.  Avoid  specifying,  as  part  of  the  relia¬ 
bility  program,  organizational  or  internal  (contractor)  responsibilities 
which  would  limit  or  constrain  the  contractor's  individual  approach. 

£■  Reliability  analyses  or  assessments  are 
primarily  design  guides  and  monitoring  techniques  and  should  not  be 
used  as  acceptance  criteria  in  lieu  of  acceptance  testing. 

(2)  Test  and  evaluation  requirements.  The  reliability 
requirement  is  of  little  value  if  a  method  for  measurement  is  not 
included  in  the  specification.  Conformance  to  the  requirement  is 
demonstrated  by  tests  such  as  research  and  development  acceptance 
tests,  engineer  design  tests,  engineering  service  tests,  and  environ¬ 
mental  tests.  The  requirements  for  conducting  the  tests  for  each 
item  performance  and  design  characteristic  must  be  included  in  sec¬ 
tion  4  of  the  specification  test  and  evaluation  requirements.  It  should 
be  remembered  that  te9t  data  and  test  results  may  provide  multi¬ 
purpose  information.  Therefore,  formal  tests  and  analysis  oriented 
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primarily  to  demonstrate  reliability  should  be  limited  to  those  tests 
which  provide  reliability  iniormation  not  otherwise  available. 

c.  Production  description  requirements  and  quality  assur¬ 
ance  provisions  are  summarized  below. 

(11  Requirements.  The  requirements  section  of  the  pro¬ 
duction  description  provides  the  same  information  for  production  con¬ 
tracts  as  the  requirements  section  of  a  development  document  provides 
for  development  contracts.  This  section  uses  the  drawings  and  speci¬ 
fications  for  the  item  to  be  produced  as  well  as  description  of  the 
processes  needed  for  production.  The  relationship  of  reliability  to 
the  production  description  is  primarily  one  of  insuring  that  the  level 
of  reliability  designed  into  the  item  is  maintained  during  production 
and  can  be  realized  only  if  a  successful  transition  from  design  to 
production  of  hardware  is  achieved. 

(2)  Quality  assurance  provisions  (test  and  evaluation  re¬ 
quirements.  The  specification  must,  in  addition,  set  forth  methods 
by  which  product  acceptability  can  be  determined.  This  involves 
types  of  tests  to  be  conducted,  inspection  provisions  tnd  test  methods 
and  procedures.  Quality  assurance  provisions  should  contain  descrip¬ 
tions  of  preproduction,  initial  production,  confirmatory  acceptance 
and  product  improvement  tests.  'iiese  test  provisions  provide  for 
lot  formation,  classification  of  characteristics,  and  acceptable  quality 
levels  as  well  as  number  of  failures  per  sample,  treatment  of  failures, 
preparation  of  specimens,  apparatus  and/or  reagents,  and  decision 
making  criteria.  Further  discussion  of  these  provisions  is  included 
in  chapter  6  and  appendix  F. 
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CHAPTER  4 

RELIABILITY  MODELING,  PREDICTION,  AND 
APPORTIONMENT  TECHNIQUES 

Section  I.  INTRODUCTION 


4-1.  Gene ral.  a.  Certain  reliability  analyses  involve  relating  system 
reliability  to  subsystem  or  component  reliability.  This  chapter  con¬ 
tains  a  general  method  for  constructing  models  relevant  to  such  an 
analysis.  Such  models  are  useful  for  predicting  system  reliability 
from  subsystem  reliability  data  and  for  apportioning  system  reliability 
requirements  among  the  subsystems. 

b.  In  addition  to  the  discussion  of  models,  this  chapter  discusses 
the  last  two  of  the  three  analysis  techniques  mentioned  in  Chapter  3, 
Section  II,  which  are  used  to  generate  the  essential  descriptive  informa¬ 
tion  needed  for  the  preparation  of  TDP's,  design  specifications,  requests 
for  proposals,  and  contractual  tasks  statements.  These  techniques  are 
prediction  and  apportionment. 

Section  II.  RELIABILITY  MODELS 

4-2.  General,  a.  The  reliability  model  relates  equipment  or  system 
reliability  to  subsystem  and/or  component  reliability.  These  models 
are  used  for  reliability  prediction  and  apportionment.  The  particular 
form  taken  by  the  model  is  dependent  upon  the  functional  configuration 
of  the  system  considered  and  thereby  depicts  the  effect  of  failure  on  the 
system. 

b.  The  typt  s  of  models  are  as  numerous  as  there  are  types  of 
systems.  However,  all  systems  can  be  reduced  to  combinations  and/or 
modifications  of  basic  configurations.  These  configurations  and  com¬ 
binations  thereof,  which  are  discussed  in  detail  in  Appendix  D,  are: 

(1)  Series  configurations; 

(2)  Parallel  (redundant)  configurations; 
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(3)  Mixed  (series  and  parallel)  tonii gu rations ; 

(4)  Partially  redundant  eonf i gura t inr s ;  and 

(5)  Standby  redundancy'  configurations. 

4-3.  Procedural  steps.  The  basic,  procedural  steps  fur  constructing 
a  reliability  model  may  be  stated  as  follows: 

a.  Step  1 .  Complete'y  define  the  components  and  subsystems 
and  their  relationship  to  system  success, 

b.  Step  2.  Construct  a  block  diagram  which  indicates  the  func¬ 
tion  of  each  component  or  subsystem,  including  redundancy  considera¬ 
tions.  The  block  diagram  s  constiucted  not  as  a  physical  appearance 
of  the  system,  but  to  indicate  the  function  of  eacii  subsystem  relative 
to  system  function.  In  general,  a  reliability  block  diagram  represents 
a  systematic  arrangement  of  functions  that  must  be  performed  and, 
when  appropriate,  the  sequence  in  which  they  must  be  performed  for 
system  success.  For  example,  the  diagram  contained  in  figure  4-1 


Figure  4-1 

Series  lllock  Diagram 


indicates  that  all  subsystems  (1,  2  and  3)  must  function  properly  if 
the  system  is  to  he  successful,  and  the  diagram  contained  in  figure  4-2 


-fTM 
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Figure  4-2 

Parallel  Block  Diagram 


AN!  C  1  ’  7 02  -  i 


indicate:;  that  the  system  will  he  a  suau'ss  i!  at  least  one  of  the  sub¬ 
systems  (1,  2  or  i)  (urn  lion  ]-> i1  * > pe ■  i‘  1  y . 

c.  Step  3.  from  the  block  rUaiirani,  develop  the  mathematical 
model  as  shown  in  appendix  P. 

Section  111.  RE  L1A13I  LIT  V  PREDICTION 

4-4,  General,  a.  Reliability  prediction  is  the  process  whereby  a 
numerical  value  is  assigned  indication  the  ability  of  a  design  or  pro¬ 
posed  design  to  perform  in  accoumticc  with  specified  reliability 
r  equireme  nt  s . 

b.  The  primary  objective  of  reliability  prediction  is  tv:  provide 
guidance  relative  to  expected  inherent  reliability  of  a  given  design. 
Information  obtained  from  prediction  techniques  is  most  useful  early 
in  the  life  cycle;  specifically,  during  the  conceptual,  definition,  and 
development  phases.  Basically,  the  purpose  of  reliability  prediction 
includes  feasibility  evaluation,  comparison  of  alternative  configurations, 
identification  of  potential  problems,  logistics  support  planning,  deter¬ 
mination  of  data  de  f  i  ei  ein  i  e  s ,  tradeolt  decisions,  apportionment  oi 
requirements,  etc.  Some  important  uses  of  reliability  prediction 
include : 

(1)  Establishment  of  firm  reliability  requirements  in  QMR's 
andSDR's,  TDP's,  preliminary  design  specifications  and  requests 
for  proposals,  as  well  as  determination  of  the  feasibility  of  a  proposed 
reliability  requi  rente  nt. 

(21  Comparison  of  the  established  reliability  requirement 
with  stale  of  the  art  feasibility  for  guidance  in  budget  and  schedule 
deei  sjons. 


(3)  Providing  a  basis  for  uniform  proposal  preparation  and 
evaluation  and  ultimate  contractor  selection. 

(4)  Evaluation  of  reliability  predictions  submitted  in  techni¬ 
cal  proposals  and  reports  in  precontract  transactions. 
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(5)  Identification  and  ranking  ot  potential  problem  areas 
and  the  suggestion  of  possible  solutions. 

(6)  Apportionment  of  reliability  requirements  among  the 
subsystems. 

(7)  Evaluation  of  the  choice  of  proposed  parts,  materials, 
comoonents  and  processes. 

(8)  Conditional  evaluation  of  the  design  for  prototype 
fabrication  during  the  development  phase. 

(9)  Provides  a  basis  for  trade-off  analysis. 

4-5.  Feasibility  prediction  procedure.  The  feasibility  prediction  pro¬ 
cedure  is  useful  during  the  conceptual  phase  from  initial  design  con¬ 
cept  to  its  preliminary  paper  design.  Details  of  the  product  are,  at 
this  time,  usually  restricted  to  those  which  may  be  derived  from 
existing  products  having  similar  functional  and  operational  require¬ 
ments.  The  procedure  may  be  defined  by  the  following  steps 

a.  Sty y  1.  Define  the  product. 

(1)  Determine  its  purpose,  intended  function,  or  mission, 

(2)  Determine,  in  terms  of  performance  requirements, 
the  conditions  which  constitute  product  failure. 

(3)  Determine  functional  and  physical  boundaries  of  the 
system  for  which  the  prediction  will  be  made. 

b.  Step  2.  Establish  the  reliability  model. 

(1)  Construct  a  reliability  block  diagram  to  the  lowest  identi¬ 
fiable  function,  showing  the  relationships  necessary  for  successful  sys¬ 
tem  operation.  Clearly  indicate  alternate  modes  of  operation, 

(2)  Establish  a  mathematical  model  relating  system  relia¬ 
bility  to  the  functional  blocks  in  the  block  diagram. 
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c.  Step  3.  (1)  Establish  the  functional  complexity. 

(a)  Estimate  the  complexity  of  each  block  in  terms  of 
the  number  and  use  of  functional  parts. 

(b)  Determine  failure  rates  associated  with  these  parts. 

(c)  Combine  part  failure  rates  to  establish  a  predicted 
failure  rate  for  the  block. 

(2)  Many  electronic  part  failure  rates  may  be  found  in  MIL- 
ITDBK  -  2  !  7A.  For  electronic  oarts  not  covered  in  this  handbook, 
as  weLl  as  nonelectronic  parts,use  available  existing  data  and  identify 
the  source  or  estimate  the  failure  rate  from  experience  with  existing 
equipment  of  similar  design  and  function. 

d.  Step  4.  Compute  predicted  system  reliability  by  utilizing  the 
mathematical  model  and  the  functional  block  predictions. 

4-6.  Design  prediction  procedure.  This  procedure  is  useful  during  the 
design  phase  which  may  continue  through  construction  of  prototype, 
preproduction  ,  and  production  models.  During  this  time,  detailed 
schematics,  breadboards,  mockups,  firm  part  selections  and  descrip¬ 
tion,  and  complete  functional  block  diagrams  are  developed.  In 
addition,  information  pertaining  to  environmental,  storage,  final  pack¬ 
aging,  and  handling  conditions  become  available.  Thus,  prediction  at 
this  time  is  more  dependable  than  that  of  the  feasibility  study.  Predic¬ 
tions  during  this  portion  of  the  product  cycle  shali  be  made  at  intervals 
specified  by  the  procuring  agency  for  information  regarding  reliability 
growth.  The  steps  for  the  procedure  are: 

a.  Step  1.  Define  the  system  in  the  same  manner  as  indicated  by  the 
feasibility  prediction  procedure. 

b.  Step  2.  Establish  the  reliability  model  in  the  same  manner  as 
indicated  by  the  feasibility  prediction  procedure. 
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c.  Step  3.  Determine  the  part  population  for  each  functional 
block.  In  addition  to  compiling  a  list  of  individual  parts,  include 
detailed  information  on  factors  that  are  pertinent  to  reliability. 

d.  Step  4.  Determine  appropriate  stress  factors  for  each  part 
in  its  particular  application. 

e.  Step  5.  Assign  applicable  failure  rate  to  each  part. 

f.  Step  6.  Compute  reliability  for  each  functional  block  utilizing 
the  mathematical  model  and  the  predicted  reliability  of  the  parts. 

g.  Step  7.  Compute  predicted  reliability  for  the  system  using 
the  mathematical  model  and  the  predicted  block  reliability. 

4-7.  Specific  techniques  of  reliability  prediction.  There  are  several 
sources  of  guidance  for  prediction  procedures.  Three  techniques  are 
discussed  herein. 

a.  AGREE  technique  for  design  phase  prediction.  This 
technique  recommends  a  procedure  for  design  star.e  prediction 
of  reliability  of  new  equipment  (electronic).  The  reliability 
function  for  this  procedure  uses  the  exponential  distribution. 
The  technique  is  summarized  by  the  following  steps: 


(1)  Step  1.  Define  the  equipment  explicitly  and  uniquely  in 
terms  of  its  functions,  boundar  points,  operating  conditions  and  per¬ 
formance  characteristics. 

(2)  Step  2.  Specify  the  components  within  the  system.  Com¬ 
ponents  must  be  uniquely  identifiable  without  duplication  and  must  be 
selected  in  such  a  way  as  to  take  into  account  any  redundancy  and 
independence  of  operation. 

(3)  Step  3.  Select  the  parts  which  have  a  dominant  effect  on 
system  reliability,  either  because  of  their  large  number  or  because 
of  their  large  failure  rate,  etc. 
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(4)  Step  4.  Determine  a  failure  rate  for  each  part  or  class 
of  parts  used  in  each  component  of  the  system.  If  parts  are  grouped 
and  not  analyzed  singly,  then  classification  of  parts  could  be  made  in 
terms  of  homogeneity  of  failure  rate,  such  as:  tubes  with  high  temper¬ 
ature  of  operation;  tubes  with  low  temperature;  tubes  that  can  deteri¬ 
orate  to  the  life  test  end  point;  tubes  that  can  deteriorate  well  below 
life  test  end  point;  condensers  with  high  voltage  applied;  resistors  with 
high  power  rating;  etc.  From  data  obtained  from  MIL-HDBK-2  17A,  or 
other  available  sources,  the  failure  rate  as  related  to  the  various 
stresses  applied  to  the  parts  will  be  estimated.  In  the  case  of  new  parts 
or  applications,  it  may  be  necessary  to  obtain  new  data  through  special 
investigations. 

(5)  Step  5.  Determine  a  failure  rate  for  each  component  within 
the  equipment.  Add  the  failure  rates  for  all  parts  in  each  component 

of  the  equipment  as  determined  in  Step  4  to  obtain  the  figures  for 
component  failure  rates. 

(6)  Step  6.  Determine  the  failure  rate  for  each  component. 

(7)  Step  7.  Determine  a  failure  rate  for  the  equipment.  Add 
the  failure  rates  for  all  independent  components  within  the  equipment 
to  obtain  the  figure  for  the  equipment  failure  rate. 

(8)  Step  8.  Determine  the  predicted  reliability  function  for 
the  equipment.  The  reliability  for  the  equipment  is  based  on  the 
exponential  failure  distribution  and  is  dependent  upon  failure  rate  and 
mission  time. 

(9)  Step  9.  Determine  the  predicted  mean  time  between 

equipment  failures  (MTBF),  The  predicted  mean  number  of  hours 
between  malfunctions  is  the  reciprocal  of  failure  rate. 

b.  AR1NC  technique  of  predesign  reliability  prediction.  A  pre¬ 
design  reliability  prediction  for  ground  electronic  systems  has  been 
developed  by  ARINC  Research  Corporation.  T*  was  intended  to  provide 
prediction  of  reliability  during  the  early  planning  stages  and,  as  a  con¬ 
sequence,  is  based  on  general  information  which  can  only  be  estimated. 
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The  procedure  provides  a  method  for  estimating  confidence 
intervals  associated  with  the  predictions. 

c.  NAVSHIPS  offers  four  methods  for  obtaining  reli¬ 
ability  predictions  for  electronic  items.  Each  method  per¬ 
tains  to  a  different  category  configuration. 

(1)  The  first  method  deals  with  system  reliability  prediction 
from  "typical11  equipment  failure  rates.  It  pertains  to  systems  which 
will  be  comprised  of  subsystems  similar,  in  parts  count,  to  equipment 
which  has  been  used  in  the  past. 

(2)  The  second  method  applies  to  nontypical  equipment 
in  terms  of  the  number  of  parts  employed.  It  utilises  a  factor  to  be 
multiplied  by  the  number  of  parts  to  obtain  a  prediction  of  failure 
rate. 


(3)  The  third  method  utilizes  parts  failure  rate  by  part  cate¬ 
gory  in  prediction  of  reliability.  Employment  of  this  method  requires 
a  count  of  the  various  type  parts  included  in  the  design. 

(4)  The  fourth  method  is  the  most  detailed  of  the  group  and 
deals  with  reliability  prediction  of  equipment  or  circuits  from  parts 
rates  with  severity  function.  It  requires  not  only  a  parts  count  but 
the  design  must  be  carefully  analyzed  to  determine  the  severity  of 
stress  to  which  each  part  will  be  subjected. 

Section  IV.  RE  .LIABILITY  APPORTIONMENT 

4-8.  General,  a.  Reliability  apportionment  (allocation)  represents 
the  assignment  of  reliability  goals  or  requirements  to  subsystems  in 
such  a  manner  that  the  system  reliability  goals  or  requirements  will 
be  satisfied.  Whereas  prediction  utilized  the  reliability  model  to  ob¬ 
tain  system  reliability  from  subsystem  reliability  values,  apportion¬ 
ment  makes  use  of  the  same  models  by  proceeding  from  system  reli¬ 
ability  goals  to  compatible  subsystem  goals. 
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b.  Apportioned  reliability  requirements  will  prove  useful  for 
directing  reliability  effort  along  profitable  channels  and  keeping  the 
development  effort  compatible.  A  few  important  uses  '  r  liability 
apportionment  are  listed. 

(1;  During  the  conceptual  phase,  apportionment  of  proposed 
reliability  requirements  will  provide  an  aid  in  determination  of  feasi¬ 
bility, 

(2)  When  various  subsystems  are  being  developed  by  different 
contractors,  apportionment  will  provide  compatible  contractual  relia¬ 
bility  requirements. 

(3)  Apportionment  will  provide  the  prime  contractor,  as  well 
as  government  monitors,  with  a  means  of  evaluating  subcontractor 
reliability  achievements. 

(4)  Apportioned  reliability  requirements  may  be  used  as 
developmental  goals  for  parts  and  subsystems.  Consequently,  relia¬ 
bility  growth  progress  can  be  monitored  for  subsystems  with  the 
result  that  problem  areas  may  be  discovered  and  such  problems 
alleviated  by  reallocation  of  resources  and  efforts  or  initiating 
appropriate  reliability  trade-offs. 

4-9.  Considerations  for  reliability  apportionment.  The  ideal  appor¬ 
tionment  would  be  the  allocation  of  requirements  resulting  in  the  most 
economical  use  of  resources,  including  time  and  cost.  Apportionment 
of  reliability  is  a  trade-off  between  the  reliabilities  of  units  to  achieve 
a  specified  system  reliability.  By  imposing  high  requirements  on 
those  units  in  which  high  reliability  is  easier  to  attain,  and  lower 
requirements  on  those  in  which  high  reliability  is  more  difficult  and 
more  costly,  the  overall  cost  of  system  development  may  be  reduced. 

A  few  important  factors  for  consideration  follow. 

a.  The  complexity  of  the  system  will  nave  an  effect  on  the 
achievable  reliability.  The  more  complex  the  system,  the  greater  the 
number  of  subassemblies  and  modules,  the  more  difficult  and  costly 
it  is  to  achieve  a  high  reliability.  Imposing  an  unrealistically  high  re¬ 
liability  on  the  more  complex  systems  increases  the  cost  dispropor¬ 
tionately  when  compared  with  the  effect  of  increasing  the  reliability 
requirement  for  simpler  systems. 
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b.  The  amount  of  development  and  research  required  to  produce 
the  system  will  greatly  influence  the  time  and  cost  of  development. 
Imposition  of  a  high  reliability  requirement  on  a  system  under 
development  will  increase  the  development  time,  number  of  tests 
required  to  obtain  the  reliability,  and  the  cost. 

c.  The  intended  operational  environment  will  have  an  effect  on 
the  achievable  reliability.  A  system  to  be  used  in  a  rugged  environ¬ 
ment  will  tend  to  cost  more  to  develop  to  an  equal  reliability  than  a 
similar  one  to  be  used  under  less  severe  conditions. 

d.  The  length  of  time  the  equipment  is  required  to  perform  will 
influence  the  achievable  reliability.  It  will  require  more  development 
effort  and  cost  to  produce  a  system  capable  of  operating  for  a  long 
period  of  time  without  failure  than  to  develop  one  for  a  shorter  period 
of  use. 


e.  The  need  for  high  reliability  in  a  component  is  based  on  the  im¬ 
portance  of  its  operation.  A  component  whose  failure  would  not  jeopardi: 
the  accomplishment  of  the  mission  need  not  be  highly  reliable.  To  the 
extent  that  failures  can  be  tolerated,  lower  reliability  requirements 
should  be  imposed. 

4-10.  Specific  techniques  of  reliability  apportionment.  Several  techni¬ 
ques  of  reliability  apporti.  .orient  have  been  discussed  in  the  literature. 
Those  to  be  presented  herein  are  the  equal  apportionment  method,  the 
AGREE  method,  a  method  by  ARINC  Research  Corporation,  and  two 
methods  for  minimizing  total  effort  expended.  More  detail  is  found 
in  appendix  D. 

a.  Equal  apportionment  technique.  In  the  absence  of  definitive 
information  on  the  system,  other  than  the  fact  that  n  subsystems  are 

to  be  used  in  series,  equal  apportionment  to  each  subsystem  would  seem 
reasonable.  In  this  case,  the  root  of  the  system  reliability  require¬ 
ment  would  be  apportioned  to  each  of  the  n  subsystems. 

b.  AGREE  apportionment  technique.  A  method  of  apportionment 
for  electronics  systems  is  outlined  in  the  AGREE.  This  technique 
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takes  into  consideration  both  the  complexity  and  importance  of  each 
subsystem.  It  assumes  a  series  of  k  subsystems,  each  with  exponen¬ 
tial  failure  distributions.  The  apportioned  reliability  goal  is  expressed 
in  terms  of  MTBF. 

c.  ARINC  apportionment  technique.  This  method  assumes 
series  subsystems  with  constant  failure  rates  such  that  any  subsystem 
failure  causes  system  failure  and  that  subsystem  mission  time  is  equal 
to  system  mission  time.  This  apportionment  technique  requires  ex¬ 
pression  of  reliability  requirements  in  terms  of  failure  rate. 

d.  Minimization  of  effort  algorithm.  This  algorithm  con¬ 
siders  minimization  of  total  effort  expended  to  meet  system  reliability 
requirements.  It  assumes  a  system  comprised  of  n  subsystems  in 
series.  Certain  assumptions  are  made  concerning  the  effort  function. 
It  assumes  that  the  reliability  of  each  subsystem  is  measured  at  the 
present  stage  of  development  or  is  estimated,  and  apportions  relia¬ 
bility  such  that  greater  reliability  impi'ovement  is  demanded  of  the 
lower  reliability  subsystems. 

e.  Dynamic  programming  approach.  11  all  subsystems  are 
not  equally  difficult  to  develop,  dynamic  programming  provides  an 
approach  to  reliability  apportionment  with  minimum  effort  expenditure 
when  the  subsystems  are  subject  to  different  but  identifiable  effort 
functions. 


CHAPTER  5 


RELIABILITY  DESIGN  AND  REVIEW 
Section  I.  INTRODUCTION 

5-1.  General.  During  development,  a  design  is  formulated  to  meet 
quantitative  requirements  previously  defined.  The  results  of  these 
activities  provide  inputs  for  all  future  actions.  The  importance  of  de 
signing  in  the  required  degree  of  reliability  cannot  be  overemphasized 
for  once  the  design  is  approved,  inherent  reliability  is  fixed.  Less 
than  perfect  compliance  with  required  actions  from  this  point  may  re¬ 
sult  in  an  achieved  reliability  level  less  than  the  fixed  inherent  level. 
This  concept  is  illustrated  in  figure  5-1. 


Figure  5-1 

Reliability  Growth  During  System  Life 
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Section  II.  SOME  BASIC  PRINCIPLES  OF 
RELIABILITY  DESIGN 

5-2.  General,  This  chapter  deals  with  identification  of  some  basic 
principles  of  reliability  design  of  which  the  designer  should  be  aware 
and  with  the  concept  of  design  reviews.  Each  is  discussed  briefly  in 
terms  of  its  role  in  the  design  of  rt  liable  equipment. 

5-3.  Simplicity.  Simplification  of  item  configuration  can  contribute 
to  reliability  improvement  mainly  by  reducing  the  number  of  possible 
failure  modes.  A  common  approach  toward  design  simplification, 
especially  structural,  is  that  of  component  integration,  l.  e.  ,  the  use  of 
a  single  part  to  perform  multiple  functions, 

5  -  4 .  Use  of  pr  oy.  -  n  componen  t  s ,  preferred  c.  i  remits,  and  preferred  design 

concepts .  a.  If  reliability  is  to  be  designed  into  an  item,  the  reliability 
of  the  individual  components  must  be  predicted  oi  estimated.  When 
working  within  time  and  cost  constraints,  it  is  wise  to  use  proven  com¬ 
ponents  where  possible,  thus  minimizing  analysis  and  testing. 

b.  Information  is  available  concerning  reliability  of  certain 
component  configurations  and  circuits.  There  are  electronic  design 
handbooks  available,  for  example,  illustrating  standard  circuitry  which 
should  be  used  in  preference  to  unique  designs.  Just  as  with  electronic 
designs,  proven  mechanical  and  fluid  system  design  concepts  can  be 
categorized  and  proven  configurations  given  first  preference. 

c.  Existing  standards  must  be  constanliy  reviewed  and  updated. 

The  establishment  of  new  hardware  standards  must  be  preceded  by 
thorough  reliability  verification.  Some  areas  in  standardization  which 
are  important  to  reliability  design  are  standard  values,  parts,  compo¬ 
nents,  systems  and  subsystems.  Another  area  of  importance  is  that 

of  analysis  techniques.  Accepted  methods,  such  as  reliability  prediction, 
can  be  established  for  use  by  design  and  reliability  engineers.  These 
analysis  methods  are  useful  provided  their  limitations  are  recognized. 

5-5.  Stress/strength  design,  a.  The  classical  approach  to  design 
is  to  give  every  part  enough  strength  to  handle  the  worst  stress  it  will 
encounter.  Several  references,  such  as  MIL-HDBK-5  are  available 
providing  data  on  the  strength  oi  materials,  and  some  of  those  provide 
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limited  data  on  strength  degradation  with  time,  resulting  from  fatigue. 
However,  when  designing  for  a  specified  reliability,  the  traditional 
and  common  use  of  safety  factors  often  is  inadequate.  Effective  design 
procedures  should  provide  for  evaluating  alternative  configurations  with 
respect  to  reliability.  Since  failure  is  not  always  related  to  time,  the 
designer  needs  techniques  lor  comparing  stress  vs.  strength.  These 
include: 

(1)  Derating.  Use  parts  rated  higher  than  expected  stress. 

(2)  Reliability  margin.  Measure  the  separation  between 
•stress  and  strength. 

(3)  Stress  /  strength  testing.  Determine  the  stress  and 
strength  distributions. 

b.  The  concept  of  stress-strength  in  design  recognizes  the  reality 
that  loads  or  stresses  and  strengths  of  particular  items  subjected  to  these 
stresses  cannot  be  identified  as  a  specific  value  but  have  ranges  of  values 
with  a  probability  of  occurrence  associated  with  each  value  in  the  range. 

c.  The  reliability  of  an  item  may  be  defined  as  the  probability 
that  the  strength  of  that  item  will  never  be  less  than  the  stress  to  which 
it  will  be  subjected  (see  appendix  A  for  analytic  methods  of  determining 
reliability  using  stress  and  strength  distributions).  There  are  four 
basic  procedures  the  designer  may  use  to  increase  reliability. 

(1)  Increase  average  strength.  This  approach  is  tolerable 
if  size  and  weight  increases  can  he  a  .-copied  or  if  a  stronger  material 
is  available. 


(2)  Decrease  average  stress.  Occasionally  the  average 
stress  on  a  component  can  be  reduced  without  greatly  affecting  its  ca¬ 
pability. 


(3)  Decrease  stress  variation.  The  variation  in  stress 
is  usually  hard  to  control.  However,  the  stress  distribution  can  be 
effectively  truncated  by  putting  limitations  on  use  conditions. 
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(4)  Decrease  strength  variation.  The  inherent  part  to 
part  variation  in  strength  can  be  reduced  by  improving  the  basic  process, 
holding  tighter  control  over  the  process,  or  by  utilizing  tests  to  eliminate 
the  less  desirable  parts. 

5-6.  Redundancy.  Redundancy  provides  more  than  one  way  to  accom¬ 
plish  a  function.  In  some  design  situations,  reliability  improvement 
may  be  achieved  by  introducing  redundant  subsystems  or  components. 

For  details  of  various  evaluation  models,  see  appendix  D. 

5-7.  Local  environment  control.  Often  it  becomes  apparent  during 
design  that  a  severe  local  environment  would  prevent  achievement  of  the 
required  component  reliability.  The  design  engineer  is  faced  with  the 
choice  of  improving  the  component  to  withstand  the  environment  or,  if 
possible,  changing  the  environment  to  satisfy  the  component.  Such 
local  environment  control  may  add  weight,  space  and  cost;  so  tradeoffs 
must  be  evaluated  on  the  basis  of  overall  effectiveness.  Some'imes 
overlooked  is  the  harmful  effect  of  transportation  and  installation  as 
opposed  to  operation.  Improved  packaging  and  special  handling  in¬ 
structions  may  be  necessary  to  preserve  reliability.  Some  typical 
environmental  problems  are: 

a.  Shock  and  vibration.  There  are  two  approaches  that  may 

be  taken  when  shock  or  vibration  are  present.  Either  isolate  the  equip¬ 
ment  or  build  it  to  withstand  the  shock  or  vibration.  The  problem  with 
isolation  is  that  effective,  simultaneous  control  of  both  shock  and  vi¬ 
bration  is  difficult.  When  only  one  or  the  other  is  present,  special 
mountings  are  often  used. 

b.  Heat.  In  virtually  any  kind  of  system,  heat  buildup  increases 
the  possibility  of  failure.  Commonly  used  methods  of  heat  transfer 
include  free  convection,  forced  air  cooling,  liquid  cooling,  conduction, 
radiation  and  vaporization  cooling. 

c.  Corrosion.  The  following  design  considerations  are  used 
to  provide  protection  against  corrosion: 

(1)  Use  corrosion  resistant  materials. 

(2)  Use  plating  and  protective  finishes. 


5-4 


AMCP  702-  3 


(3)  Avoid  dissimilar  metal  contact. 

(4)  Control  the  environment  (prevent  water  entrapment, 
remove  atmospheric  moisture,  etc.  } 

5-8.  Identification  and  elimination  of  critical  failure  modes,  a.  Fail¬ 
ure  mode  and  effect  analysis  (FMEA)  is  an  effective  technique  for 
revealing  design  deficiencies  and  potential  hazards.  The  FMbA  team, 
to  be  most  effective  relative  to  reliability,  should  include  a  reliability 
and  a  design  engineer. 

b.  FMEA  is  nothing  more  than  a  thorough  analysis  of  the  questions: 
"How  could  .  .  .  fail9  "  a-'**  "What  would  happen  if  .  .  .  fails?  "  FMEA  is 
more  than  a  check  on  a  wsign.  The  design  concept  can  be  developed 
using  this  technique  as  follows: 

(1)  Start  with  a  functional  block  diagram  to  determine  import¬ 
ance  of  each  function. 

(2)  Based  on  this  importance,  certain  configurations  may  be 
developed. 

(3)  Analysis  of  the  resulting  design  for  compatibility  between 
failure  effects  and  predicted  failure  probability. 

5-9.  Self-healing.  A  design  approach  which  has  possibilities  for  future 
development  is  the  use  of  self-healing  devices.  Perhaps  the  simplest 
example  of  a  self-healing  device  is  'ire  with  a  layer  of  sealing  com¬ 
pound  which  will  seal  any  small  punctures.  A  similar  technique  is  used 
in  some  aircraft  fuel  cells.  In  this  case,  a  puncture  exposes  a  layer 
of  uncured  rubber  which  swells  to  seal  the  leak.  Automatic  sensing  and 
switching  devices  represent  a  form  of  self-healing. 

5-10.  Detection  of  impending  failure.  Achieved  reliability  in  the  field 
may  be  facilitated  by  the  introduction  of  methods  and/or  devices  for 
detecting  impending  failures.  Such  devices  may  be  used  for: 

a.  Screening  of  parts  and  components. 

b.  Periodic  maintenance  schedules. 

c.  Monitoring  of  operating  equipment. 
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5-11.  Preventive  maintenance,  a.  For  continuously  operating 
repairable  items,  preventive  maintenance  procedures  may  greatly 
enhance  reliability  when  recommended  practices  are  followed.  Be¬ 
cause  such  practices  may  be  difficult  to  comply  with,  the  designer 
may  add  to  achieved  reliability  by  avoiding  the  need  for  preventive 
maintenance  to  the  highest  degree  possible. 

b,  When  the  need  for  preventive  maintenance  cannot  be 
avoided,  the  design  should  provide  for  the  longest  possible  period 
between  such  maintenance,  and  above  all  must  be  consistent  with 
the  overall  maintenance  policy,  the  availability  of  skills,  and  accessi¬ 
bility. 


c.  Finally,  the  technical  manuals  must  emphatically  call  out 
the  schedule  and  importance  of  such  maintenance  to  reliability;  and 
it  may  be  desirable  to  place  prominent  labels  containing  maintenance 
instructions  directly  on  the  equipment. 

5-12.  Tolerance  evaluation.  A  design  is  not  considered  complete 
until  it  has  been  determined  that  the  different  types  of  tolerances 
cannot  combine  in  such  a  way  as  to  interfere  with  the  intended  func¬ 
tion.  In  a  complex  item,  it  is  necessary  to  consider  the  expected 
range  of  manufacturing  process  variance,  operational  environment, 
and  all  stresses,  as  well  as  the  effect  of  time.  Tolerances  resulting 
from  environment  (temperature,  etc.)  and  time  must  be  added  to 
manufacturing  tolerances  in  order  to  determine  the  real  operational 
distribution.  Some  methods  of  tolerance  evaluation  consist  of: 

a.  Worst  case  tolerance  analysis.  Determining  whether  the 
equipment  can  perform  properly  with  all  parts  simultaneously  at  their 
tolerance  limits  and  in  such  a  direction  as  to  produce  the  greatest 
deviation  of  nominal  performance. 

b.  Statistical  tolerance  analysis.  A  statistical  procedure 
determining  the  manner  in  which  individual  parts  tolerances  affect 
the  overall  tolerance.  This  avoids  the  inherent  pessimism  of  the 
worst  case  approach. 

c.  Marginal  checking.  A  quantitative  method  for  stating 
what  sensitivity  a  given  circuit  has  to  variations  in  its  components. 
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5 -  i  3 .  Prediction  and  apportionment,  a.  The  role  of  reliability  p  re  - 
diction  during  design  is  that  of  providing  an  evaluation  of  a  proposed 
design  and  to  provide  a  comparison  of  alternative  designs.  Similarly, 
apportionment  provides  an  approach  for  identifying  reliability  goals 
for  subsystems  in  such  a  combination  so  as  to  afford  design  feasibility. 
Generally,  these  procedures  may  be  useful  in  the  following  applications: 

(11  As  a  planning  tool  for  the  initial  establishment  of  re¬ 
liability  requirements. 

(2)  As  a  design  tool  to  guide  the  designer  in  the  choice  of 
parts  to  meet  the  specified  reliability  requirement. 

(3)  As  a  design  review  tool  by  management  for  the  evalua¬ 
tion  of  design  adequacy  to  meet  the  reliability  requirement  and  to  point 
up  potential  reliability  problem  areas  for  design  correction. 

(4)  As  a  monitoring  tool  for  the  assessment  of  development 
program  progress  toward  established  goals  to  predict  and  circumvent 
oncoming  problems  before  the  hardware  stage. 

b.  Design  reliability  assessments  can  be  divided  into  two 

phases : 

(1)  The  conceptual  or  design  proposal  phase.  A  predic¬ 
tion  is  based  on  the  design  concept  as  reflected  in  development  speci¬ 
fications  and  early  design  documentation. 

(Z)  The  design  or  development  phase .  Predictions  are 
based  on  the  actual  design. 

c.  For  prediction  and  apportionment  methodology,  see  chap¬ 
ter  4. 


5-14.  Human  engineering.  Mistakes  by  people  often  result  in  failure 
of  an  item  to  perform  its  function.  Therefore,  human  activities  and 
limitations  may  be  very  important  to  item  reliability.  The  reliability 
of  people  can  be  influenced  by  the  design  engineer  by  considering  the 
factors  which  directly  refer  to  human  aspects,  such  as: 
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a.  Human  factors. 

b.  Man-machine  interface. 

c.  Evaluation  of  man  in  the  system. 

d.  Human  reliability. 

5-15.  Mean  life  ratio.  Frequently  a  design  engineer  wishes  to  evalu¬ 
ate  the  life  of  a  new  product  or  process  in  relation  to  the  old.  In  making 
a  decision,  he  should  perform  a  statistical  evaluation  on  the  variation 
between  the  two  sample  results;  or,  in  other  words,  he  would  state  that 
the  new  product  or  process  is  better  only  when  he  could  make  the  state¬ 
ment  with  a  statistically  high  confidence  of  being  correct.  A  common 
method  for  determining  the  confidence  is  the  mean  life  ratio  approach. 

Section  III.  RELIABILITY  REVIEWS 

5-16.  Gene ral.  a.  A  reliability  review  is  defined  as  planned  monitor¬ 
ing  of  a  product  to  assure  that  it  will  meet  the  expressed  and  implied 
performance  requirements  of  the  equipment  during  operational  use. 

Such  a  review  provides  periodic  appraisal  of  the  design  effort  to  deter¬ 
mine  the  progress  being  made  in  achieving  the  design  objectives  and 
systematically  brings  to  bear  specialized  talent  on  specific  problem 
areas.  In  this  manner,  an  overall  evaluation  is  made  to  identify  speci¬ 
fic  reliability  problems  that  may  be  encountered  later  in  the  develop¬ 
ment  and  production  cycles. 

b.  Realization  of  the  full  worth  of  reliability  design  reviews 
requires  that  system  program  personnel  actively  participate  in  the  de¬ 
sign  review  process  on  all  development  programs  which  result  in  items 
entering  the  military  inventory. 

5-17.  Basic  review  philosophy.  Reviews  may  be  profitably  applied 
at  any  point  during  design  activities  ranging  from  concept  to  produc¬ 
tion.  Design  chang  s  during  the  early  design  reviews  generally  re¬ 
quire  very  little  engineering  effort  since  they  usually  involve  only 
paper  changes  of  a  part,  dimension,  or  value;  although  redesign  of 
components  might  at  times  be  mandatory.  Design  changes  occurring 
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during  subsequent  design  reviews  involving  changes  to  drawings,  modi¬ 
fications,  replacement  of  existing  hardware,  replacement  of  field  per¬ 
sonnel,  etc.,  will  be  considerably  more  costly.  The  periodic  review 
of  reliability  at  key  points  in  the  development  program  facilitates  de¬ 
tection  and  correction  of  actual  or  potential  problems  prior  to  the  final  j 

design.  i 

1 

5-18.  Required  review  points.  A  review  schedule  should  include  the  i 

time-phased  events  representing  the  appropriate  milestones  at  which  _ { 

formal  reviews  are  made  at  major  decision  points.  The  number  of  j 

critical  decision  points  will  vary  according  to  the  type  of  development  ! 

program  underway.  The  reliability  management  milestone  guide  in 
appendix  B  covers  the  basic  reliability  reviewpoints  in  the  materiel  “  - 
life  cycle.  As  reliability  reviews  are  normally  repetitious,  it  is 
recommended  the  review  points  be  expanded  and  reoriented  to  con¬ 
form  to  each  unique  program.  - 


5-9 


AMCP  702-3 


CHAPTER  6 

DEMONSTRATION  AND  TESTING 
Section  I.  INTRODUCTION 


6-1.  General,  a.  The  design  and  proper  use  of  adequate  test  and 
demonstration  methods  and  procedures  is  of  prime  importance  if  the 
user  is  to  be  assured  a  reliable  equipment  for  field  use.  This  chap¬ 
ter  is  devoted  to  a  general  description  of  such  methods  and  procedures 
which  are  applicable  to  a  wide  variety  of  equipments  and  components. 

b.  The  purpose  of  reliability  demonstrations  and  tests  is  to 
determine  current  item  reliability  level.  The  demonstration  of  hi^'h 
reliability  with  a  high  level  of  confidence  usually  requires  testing  of 
a  greater  number  of  items  than  are  available,  especially  when  con¬ 
cerned  with  complex  or  expensive  items.  Thus,  it  is  important  to 
design  tests  in  such  a  manner  that  maximum  information  can  be  ob¬ 
tained  from  a  minimum  amount  of  testing.  The  efficient  use  of 
statistical  techniques  is  often  essential. 

c.  A  major  problem  in  the  formulation  of  adequate  tests  is 
that  of  simulating  a  realistic  use  environment.  During  its  lifetime, 
an  equipment  may  be  subjected  to  many  environmental  factors  or 
stresses  such  as  temperature,  vibration,  moisture,  acceleration, 
rough  handling,  etc.  ,  and  these  stresses  may  be  encountered  singly, 
simultaneously,  or  sequentially. 

d.  The  ideal  test  program  should  provide  continuity  of  relia¬ 
bility  assessment  activities  from  prediction  through  end  item  dem¬ 
onstration  and  testing  activities. 

Section  II.  RELIABILITY  DEMONSTRATION  AND 
TEST  PROCEDURES 

6-2.  General,  a.  Reliability  demonstration  and  test  procedures 
are  applied  in  order  to  gain  information  concerning  failures  and  their 
frequency  of  occurrence. 
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b.  Demonstration  of  reliability  may  be  accomplished  by  the 
tesling  of  sample  items  and  may  be  defined  as  the  process  of  placing 
an  item  or  product  under  a  specified  set  of  conditions  and  observing 
the  results.  Such  tests  may  be  applied  to  systems,  subsystems,  or 
components . 

c.  Developmental  tests  are  quite  useful  for  estimating  the 
values  of  certain  reliability  parameters,  or  deciding  whether  the  re¬ 
liability  paramete rs  have  reached  an  acceptable  level  at  the  particular 
stage  of  development .  Statistical  estimation  techniques  and  statistical 
tests  of  hypothe se s ,  respectively,  are  utilized*for  these  purposes. 

d.  Acceptance  tests  are  used  for  deciding  whether  the  relia¬ 
bility  of  an  item  is  at  an  acceptable  level.  This  is  merely  an  adapta¬ 
tion  of  the  above-mentioned  tests  of  hypotheses.  Statistical  analysis 
will  provide  measures  of  the  risk  involved  in  these  inferences, 

e.  Life  tests  may  assume  any  of  several  different  test  dis¬ 
ciplines.  The  test  may  be  terminated  after  a  preassigned  time  has 
elapsed,  or  it  may  be  terminated  when  a  preassigned  number  of  failures 
have  occurred.  For  either  termination  criteria,  the  test  may  be  con¬ 
ducted  either  by  replacing  or  by  not  replacing  items  as  they  fail.  A 
major  difference  between  the  test  disciplines  is  that  time  terminated 
and  nonreplacement  tests  usually  are  simpler  to  conduct  than  are 
failure  terminated  and  replacement  tests. 

f.  Several  types  of  analysis  may  be  applicable  to  a  particular 
testing  situation.  The  determination  of  the  appropriate  type  must  be 
taken  into  account  during  pretest  planning.  Among  the  common  tech¬ 
niques  to  be  discussed  include:  parameter  estimation,  testing  of 
hypotheses,  acceptance  testing,  regre  s  sion  analysi  s,  accelerated 

life  testing,  and  stress-strength  testing. 

6-3.  Parameter  estimation,  a.  Tor  each  population  of  components, 
subsystems,  or  systems,  there  exists  one  or  more  numerics  which 
describe  the  entire  population.  These  numerics  are  called  population 
parameters.  If  the  important  reliability  parameters  of  a  population 
were  known,  reliability  testing  would  not  be  required.  However,  in 
practice,  they  are  not  known,  and  we  must  resort  to  submitting  sample 
items  to  tests  in  order  to  estimate  these  parameters. 
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b.  A  population  may  be  a  group  of  existing  items,  or  it  may 
pertain  to  items  potentially  generated  by  a  process.  The  difference 
iB  reflected  by  the  interpretation  of  the  estimated  parameters.  In 
the  first  case,  the  estimated  parameter  describes  existing  items  or 
equipments;  and  in  the  second  case,  the  estimated  parameter  de¬ 
scribes  the  capability  of  the  process  for  generating  reliable  items. 

c.  An  estimate  of  a  reliability  parameter  may  take  the  form 
of  either  a  point  or  an  interval  to  which  a  degree  of  confidence  may  be 
attached.  A  point  estimate  is  merely  a  single  number  which  is  de¬ 
fined  as  the  estimated  value  of  the  parameter  of  interest,  e.g.  ,  the 
population  MTBF  nay  be  estimated  as  100  hours.  The  confidence 
interval  consists  o.  the  statement  that  the  parameter  falls  between 
two  numerical  values  with  the  associated  degree  of  confidence.  The 
confidence  interval  is,  in  effect,  a  measure  of  precision, 

d.  The  estimation  of  reliability  parameters  is  facilitated  if 
the  underlying  distribution  of  failure  times  is  known.  Analysis  tech¬ 
niques  which  do  not  depend  on  a  known  failure  time  distribution  are 
known  as  nonparametr ic  techniques.  In  general,  nonparametric  re¬ 
liability  analysis  has  the  advantage  of  providing  information  without 
prior  knowledge  of  the  failure  distribution,  but  it  also  has  the  dis¬ 
advantage  of  less  precise  information  than  that  obtained  when  the 
underlying  distribution  is  known. 

e.  Knowledge  of  the  failure  distribution  usually  depends  upon 
historical  information  about  similar  items  or  upon  a  relatively  large 
sample  by  which  the  hypothesized  distribution  can  be  tested.  Since 
most  development  tests  are  based  upon  a  small  sample  of  prototype 
models,  and  in  many  cases  no  historical  information  exists  for  simi¬ 
lar  items,  nonparametric  analysis  may  be  necessary. 

f.  Appendix  F  contains  several  analysis  procedures  per¬ 
taining  to  the  estimation  of  reliability  parameters.  These  apply  to  : 


(11  Unknown  distribution  of  failure  times. 

(2)  Determination  of  the  underlying  distribution  of 
failure  times. 
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(3'  Normal  failure  times. 

(4'  Exponential  failure  times. 

( •'  i  Weibull  failure  times. 

6-4.  Tests  of  hypotheses.  The  preceding  comments  on  test  analysis 
were  concerned  with  estimating  the  value  of  certain  parameters.  Ti 
is  sometimes  more  meaningful  to  decide  whether  or  not  the  parameters 
are  at  acceptable  levels.  Such  decisions  may  be  accomplished  by  hy¬ 
pothesizing  a  value  for  the  parameter  of  interest  and  using  the  test  re¬ 
sults  to  decide  whether  the  hypothesis  should  be  accepted  or  rejected. 
These  procedures  are  referred  to  as  tests  of  hypotheses  and  are  dis¬ 
cussed  in  detail  in  appendix  F. 

6-5  Acceptance  testing.  The  test  of  hypothesis,  when  used  as  a 
basis  for  accepting  material,  is  sometimes  referred  to  as  an  accept¬ 
ance  test.  There  are  a  number  of  government  documents  which  con¬ 
tain  reliability  test  plan  tables.  These,  too,  are  discussed  in  appen¬ 
dix  F. 


6-6.  Regression  analysis.  Regression  analysis  sometimes  may  be 
used  to  determine  a  reliability  parameter  for  various  stress  levels 
or  design  characteristics,  such  as  determination  of  the  mean  time  to 
failure  at  different  levels  of  stress,  e.g.,  determination  of  the  rocket 
bursting  pressure  for  different  waii  thicknesses.  The  determinations 
are  useful  for  evaluating  equipment  design,  identifying  trouble  areas, 
and  potential  corrective  activities,  etc.  Regression  analysis  tech¬ 
niques  are  sometimes  used  to  generate  this  type  information  from 
test  results.  For  these  methods,  see  appendix  F. 

6-7,  Accelerated  life  testing,  a.  Life  tests,  conducted  at  or  near 
normal  operating  stresses,  have  proven  useful  for  evaluating  an 
equipment  with  regard  to  reliability  and  for  providing  data  to  be  used 
in  reliability  improvement  activities.  The  extreme  test  duration  time 
poses  a  serious  problem  when  conventional  life  testing  procedures  are 
used  to  demonstrate  very  high  reliability.  This  life  test  duration  time 
can  sometimes  be  shortened,  however,  by  utilizing  the  functional  re¬ 
lationship  between  life  characteristics  and  variable  stress  conditions. 
The  technique  of  inducing  failures  by  subjecting  test  items  to  exces¬ 
sive  stresses  is  known  as  accelerated  life  testing. 
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b.  The  p rimary  purpose  of  accelerated  life  testing  is  to  re¬ 
duce  the  time  required  to  obtain  failure  data.  This  data,  however,  is 
not  representative  of  reality  and  must  be  transformed  to  failure  data 
pertaining  to  normal  stress  conditions  by  means  of  a  functional  rela¬ 
tionship  between  stress  level  and  failure  occurrence. 

c.  Accelerated  life  testing  can  be  successful  only  if  the  func¬ 
tional  relationship  is  available  from  existing  sources  or  if  it  can  be 
determined  experimentally,  and  if  additional  modes  of  failure  are  not 
introduced. 

d.  MIL-HDBK-2 17A,  Reliability  Stress  and  Failure  Rate 
Data  for  Electronic  Equipment,  provides  data  concerning  stress  levels 
versus  failure  rate  for  certain  electrical  components.  The  data  in 
this  handbook  were  intended  for  reliability  prediction  purposes,  but 
the  included  adjustment  factors  would  allow  failure  rate  transforma¬ 
tion  from  one  stress  level  to  another. 

6-8.  S^ess-sirength  testing,  a.  St  ress-slrcnglh  testing  techniques 
may  be  used  for  evaluating  reliability  in  instances  when  time  or  dura¬ 
tion  of  mission  does  not  contribute  significuantly  to  failure,  e.  g.  , 
mechanical  devices  and  one-shot  devices.  Analysis  techniques  for 
evaluating  reliability  for  stress  and  strength  are  discussed  in  appen¬ 
dix  A. 


b.  Stress  testing  generally  involves  simulated  usage  of  the 
item  of  interest  to  determine  ihe  stress  distribution.  The  stresses 
incurred  are  determined  by  using  such  things  as  strain  gages,  plastic 
models,  polarized  light,  etc.  The  results  arc  as  dependable  as  the 
accuracy  of  simulation  of  manufacturing  variations,  operational  «  n- 
vironment,  external  stresses,  time  effects,  and  other  important 
variables. 

c.  Strength  testing  usually  involves  some  variation  of  test¬ 
ing  under  increased  stresses  until  failure  occurs.  The  strength 
distribution  can  be  determined  by  a  number  of  tests  to  failure  caused 
by  continually  increasing  the  stress  load.  For  such  tests,  it  is  ex¬ 
tremely  important  that  failure  be  precisely  defined  before  testing. 
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d.  The  method  of  increasing  stress  of  an  item  until  it  fails 
is  applicable  only  if  there  is  no  degradation  of  strength  due  to  the 
preceding  stress  level.  In  this  case,  one-shot  testing  may  be  per¬ 
formed  where  an  item  will  be  subjected  to  a  given  stress  level;  but 
if  it  does  not  fail,  it  will  not  again  be  tested  at  an  increased  stress 
level.  By  properly  selecting  the  test  stress  levels  and  recording 
whether  the  item  failed,  it  is  possible  to  determine  the  stress  dis¬ 
tribution. 

6-9.  Reliability  testing  and  the  total  test  program.  In  general, 
tests  should  not  be  conducted  solely  for  determination  of  reliability 
characteristics,  but  should  include  consideration  of  other  technical 
characteristics.  Thus,  reliability  personnel  should  be  acquainted 
with  the  overall  Army  test  program.  To  fulfill  the  AMC  testing  con¬ 
cepts,  an  item  of  Army  materiel  must  be  tested  at  appropriate  points 
throughout  its  life  cycle.  The  reliability  considerations  associated 
with  life  cycle  testing  are  shown  in  appendix  B. 

Section  III.  TEST  DESIGN 

6-10.  General.  This  section  furnishes  guidance  in  the  application  of 
the  Army  testing  concepts  to  test  planning  and  design.  In  addition,  a 
test  matrix  is  discussed  as  an  approach  for  development  of  an  effec¬ 
tive  test  program, 

6-11.  Test  procedures.  Test  conditions  and  methods  of  data  analysis 
are  preplanned  on  the  basis  of  engineering  requirements,  test  method¬ 
ology,  and  statistical  considerations.  The  following  cycle  must  be 
completed  if  effective  and  unbiased  test  results  are  to  be  achieved- 

a.  Define  the  problem. 

b.  State  test  objective. 

c.  Establish  test  requirements. 

d.  Design  test. 

e.  Implement  test. 


f.  Analyze  results. 
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6-12,  Importance  of  technical  characteristics,  a.  The  approved 
statement  of  the  military  need  for  a  new  end  item  or  system  is  con¬ 
tained  in  the  QMR/SDR.  A  statement  of  essential  characteristics  may 
be  derived  from  this  document  to  provide  the  basic  elements  of  a  de¬ 
sign  matrix.  Such  a  matrix  serves  as  guidance  for  development  of 
the  item  or  system  in  response  to  a  stated  military  need. 

b.  In  order  to  develop  an  efficient  test  design,  it  is  essential 
that  key  performance  parameters  be  identified  to  assure  that  the  test 
program  is  comprehensive  and  complete.  Some  important  determina¬ 
tions  relevant  to  an  efficient  test  design  follow. 

(1)  Definition  of  the  overall  mission  of  the  system  under¬ 
going  test  and  evaluation. 

(2)  Breakout  of  the  overall  mission  into  major  system 
characteristics. 

(3t  Further  breakout  of  each  major  system  characteris¬ 
tic  into  a  related  set  of  subsystem  characteristics. 

(4)  Identification  and  definition  of  required  subsystem 
characteristics  necessary  for  each  element  of  the  system  requiring 
evaluation. 

(5)  Determination  of  critical  high  risk  characteristics 
which  are  essential  to  successful  system  performance. 

c.  These  determinations  provide  an  orderly  breakout  of  per¬ 
formance  characteristics  such  that  the  test  results  may  be  evaluated 
against  some  given  standards  or  performance  criteria.  The  perform¬ 
ance  criteria  must  have  been  based  upon  an  associated  rationale  trace¬ 
able  to  intended  tactical  pe  rformance . 

d.  End  item  performance  criteria  are  incorporated  into  the 
overall  test  plan  through  application  of  appropriate  prior  data,  use  of 
mathematical  modeling  ana  simulation  techniques,  use  of  statistical 
techniques,  and  engineering  analysis. 
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6-13.  Design  of  test  programs,  a.  The  following  discussions  apply 
to  test  programs  planned  during  any  portion  of  the  materiel  life  cycle. 

It  should  be  kept  in  mind  that  program  emphasis  changes  as  the  item 
moves  from  conception  to  obsolescence. 

b.  The  relationship  between  stated  performance  characteris¬ 
tics,  performance  criteria,  criteria  rationale  and  sample  require¬ 
ments  are  outlined  in  figure  6-1.  This  figure  represents  the  require¬ 
ment  for  a  generalized  test  matrix  upon  which  a  comprehensive  set 
of  development  and  test  objectives  can  be  based. 

c.  Figure  6-2  provides  an  example  of  a  partial  engineering 
and  service  test  matrix.  The  matrix  for  other  tests  may  be  developed 
in  a  similar  manner. 

d.  A  test  matrix  provides  a  ready  outline  for  the  development 
of  a  comprehensive  set  of  test  objectives.  Detailed  test  objectives 
provide  the  basis  for  a  test  plan.  Each  objective  should  discuss  the 
primary  purpose  of  the  test,  the  relationship  of  the  specific  test  to  the 
purpose  of  the  overall  test  program,  and  the  test  standards  which  re¬ 
quire  satisfaction.  In  all  cases,  the  performance  criteria  associated 
with  each  performance  characteristic  should  be  included.  This  in¬ 
formation,  coupled  with  the  test  method  to  be  employed  in  the  execu¬ 
tion  of  the  test  and  the  data  to  be  obtained  from  the  test,  constitutes 
the  major  portion  of  any  test  plan. 

e.  Verification  of  technical  performance  with  a  reasonably 
high  level  of  confidence  requires  a  well-designed  test  program.  In 
conjunction  with  engineering  analysis  and  test  methodology  determina¬ 
tion,  modeling  and  statistical  analysis  techniques  are  useful  for  de¬ 
velopment  of  a  test  program. 

(1)  Modeling.  The  application  of  modeling  is  a  valuable 
engineering  tool  which  provides  a  means  of  analyzing  dependent  sys¬ 
tem  characteristics  to  identify  maximum  stress  conditions.  Modeling 
techniques  provide  preliminary  performance  estimates  which  can  be 
subsequently  verified  through  test;  thus  reducing  the  empirical  element 
in  test  planning.  Some  reliability  modeling  approaches  are  treated  in 
appendix  D. 

(2)  Statistical  techniques.  Some  techniques  for  analysis 
of  test  results  are  shown  in  appendix  F. 
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Typical  Partial  Engineering  and  Service  Test 
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CHAPTER  7 

RELIABILITY  EVALUATION,  FAILURE  ANALYSIS  AND  CORRECTION 

--THE  FEEDBACK  LOOP 

Section  L  INTRODUCTION 

7-1,  General,  a.  Reliability  improvement  may  be  characterized  by- 
five  policy  type  objectives  in  order  to  concentrate  the  project  resources 
effectively.  These  are  represented  by  a  reduction  of:  safety  hazards; 
catastrophic  equipment  hazards;  failure  rate  of  highly  replicated  system 
components;  relatively  high  subsystem  failure  rates;  and  failures  which 
produce  very  high  support  costs.  Implementation  of  these  objectives 
is  brought  about  through  increased  technical  understanding  and  improve¬ 
ment  of  the  design.  Data  analysis  is  used  by  the  engineer  as  a  tool  to 
identify  those  areas  where  greater  technical  understanding  must  be 
developed.  The  nature  and  true  value  of  the  reliability  improvement 
program  thus  lies  in  the  conscientiousness  and  rigcr  with  which  relia¬ 
bility  personnel  investigate  problems  or  weak  areas  and  follow  up  with 
corrective  action.  The  determination  of  which  problems  to  pursue,  to 
what  lengths  and  by  what  means,  should  be  based  upon  thorough  under¬ 
standing  of  the  system.  Army  policies,  contractual  limitations,  and 
experience  with  previous  problems.  In  areas  not  covered  by  established 
Army  policy,  procedures  or  experience,  it  is  necessary  to  pursue  what¬ 
ever  areas  seem  to  promise  the  most  benefit  to  overall  item  reliability. 

b.  Field  operation,  in  addition  to  development  testing,  can  be 
viewed  as  an  extremely  important  --  albeit  costly  --  source  of  relia¬ 
bility  data.  A  failure  reporting  program  should  never  be  implemented 
before  making  a  careful  analysis  of  what  data  is  to  be  measured,  how 
the  data  is  to  be  analyzed  and  interpreted,  and  what  can  be  done  to 
correct  the  system  faults  as  a  result  of  such  interpretation.  The  pur¬ 
pose  of  this  chapter  is  to  provide  guidance  for  planning  such  a  testing 
and  feedback  information  program. 

c.  In  planning  for  data  collection,  it  is  just  as  important  to  collect 
data  on  successful  or  satisfactory  operations  as  it  is  to  collect  data  on 
failures.  The  use  of  statistical  analysis  techniques  should  be  explored 
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since  programs  may  sink  from  their  own  weight  where  requirements 
for  data  collection  are  excessive.  In  addition  to  collecting  data,  care 
must  be  taken  to  assure  that  the  lessons  learned  from  experience  are 
recorded  and  that  failure  modes  are  identified.  Data  collection  should 
include  plans  for  incorporating  proper  statistical  procedures  for 
evaluating  the  data.  Decisions  resulting  in  corrective  action  should 
be  made  with  careful  regard  for  the  system  mission  requirements  and 
the  effective  use  of  available  resources. 

Section  ID  OBJECTIVES  OF  A  POSITIVE  MATERIAL  FAILURE 
ANALYSIS  AND  CONTROL  SYSTEM 

7-2.  Objectives.  In  order  to  develop  a  positive  material  failure  analy¬ 
sis  and  control  system  (FACS),  the  following  objectives  should  be 
adhered  to. 

a.  Provide  only  the  pertinent  facts  needed  to  evaluate  the  criticality 
of  a  failure  by: 

(1)  Collecting  both  success  and  failure  data. 

(2)  Using  accepted  statistical  analysis  techniques  to  provide 
a  confidence  level  and  assure  the  precision  of  the  data. 

(3)  Taking  care  to  gather  data  pertaining  to  all  failure  modes. 

b.  Timely  distribution  of  failure  data  and  information  to  all 
organizational  elements  needing  such  data  through  the  use  of  a  simple 
and  quick  response  data  collection  and  reporting  system. 

c.  Provide  for  the  cause  and  effect  of  failures  to  be  established 
and  evaluated  by  the.  proper  organizational  element  in  a  methodical 
manner  which  uses  appropriate  statistical  techniques  and  quantitative 
application  of  engineering  principles. 

d.  Assure  that  cost-effective  and  timely  corrective  action  is 
taken  by: 
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(1)  Preplanned  and  scheduled  steps  for  handling  an  identified 
reliability  problem. 


(2)  Requiring  that  changes  be  made  with  due  regard  for  the 
stated  mission-responsive  requirements  of  the  system. 

(3)  Requiring  that  cost-effectiveness  principles  and  the  official 
guidelines  on  this  subject  be  adhered  to. 

e.  Closing  the  loop  on  each  action  using  the  methods  of  data  collection 
and  evaluation  provided  by  the  system  to  verify  and  evaluate  the  effective¬ 
ness  of  the  action. 

Section  IIL  METHODS  OF  DATA  COLLECTION 
AND  DOCUMENTATION 


7-3.  General,  a.  Data  collection  involves  some  met.iod  of  placing  data 
on  individual  events  into  source  documents  or  records.  Documentation 
for  reporting  purposes  involves  assembling  data  on  individual  events 
into  composite  reports  which  present  the  information  in  a  meaningful 
and  usable  form.  Masses  of  data  improperly  collected  and  assembled 
will  not  provide  needed  information.  Thus,  the  requirements  for  what 
data  is  to  be  collected,  how  it  is  to  be  collected,  and  how  it  is  to  be 
reported  are  fundamental  and  tasks  which  must  be  approached  with 
great  care  in  planning.  If  this  is  not  done,  a  tremendous  amount  of 
effort  and  resources  may  be  expended  on  an  effort  which  has  relatively 
little  value. 

b.  Basically,  data  requirements  consist  of  two  factors:  data 
elements  and  data  reports.  The  data  elements  form  the  basis  for  de¬ 
vising  individual  event  source  document  forms.  Choice  of  data  elements 
must  be  based  on  the  requirements  of  the  reliability  reports  program. 
Data  reports  reduce  the  many  individual  data  source  documents  to 
manageable  and  meaningful  form  which  communicates  pertinent  informa¬ 
tion  to  decision  makers.  The  requirements  for  these  reports  must  be 
based  on  a  detailed,  planned  concept  of  how  reliability  analysis  and 
evaluations  are  to  be  performed.  From  such  a  plan,  the  minimum 
information  needed  in  each  report  and  the  report  format  can  be  con¬ 
structed. 
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c.  After  establishing  the  requirements  for  the  data  elements 
and  data  reports,  the  method  of  implementation  is  selected,  imple¬ 
mentation  may  c  onsist  of  using  an  existing  Army  data  collection  and 
reporting  system  if  it  meets  the  requirements,  or  the  procuring  agency 
may  elect  to  develop  its  own  data  collection  and  reporting  system  if 
resources  are  available. 

7-4.  Reliability  data  sources.  The  design  engineer  is  dependent 
upon  data  feedback  of  part  performance  and  failure  data  from  a  wide 
range  of  applications  and  use  environments  if  he  is  to  optimize  design 
reliability.  Some  specific  sources  of  such  data  follow: 

a.  MIL-HDBK-21  7A,  Reliability  Stress  Analysis  for  Elec¬ 
tronic  Equipment.  This  handbook  provides  a  source  of  parts  failure 
rate  data  for  standard  electronic  and  electromechanical  parts.  Catas¬ 
trophic  part  failure  rates  observed  over  wide  ranges  of  electrical  and 
thermal  stresses  have  been  analyzed  and  presented  in  a  form  which 
permits  determination  of  the  most  likely  failure  rate  for  a  given  set 
of  stresses. 


b.  The  Army  Equipment  Record  System  (TAEkS).  The 
TAERS  system  is  designed  to  provide  field  commanders,  commodity 
command  managers,  project  managers,  and  top-level  headquarters 
with  problem-solving  data  for  improved  materiel  readiness.  It  is 

an  official  Army  method  for  reporting  information  necessary  for  con¬ 
trol  of  operation  and  maintenance  support  of  Army  equipment. 

c.  Tri-Service  and  NASA  Failure  Rate  Data  (FARADA) 
Program.  The  purpose  of  the  FARADA  Program  is  to  provide  part/ 
component  failure  rate  and  failure  mode  data  to  reliability  engineers 
and  design  engineers  engaged  in  the  design,  developme/n  and  produc¬ 
tion  of  hardware  for  the  entire  spectrum  of  military  and  apace  appli¬ 
cations.  The  information  presented  in  the  FARAD/,.  Handbooks  has 
been  obtained  from  operational  experience  on  military  and  space 
equipments  from  many  tri-service  and  NASA  contractors  and  govern¬ 
ment  agencies.  As  a  result  of  applying  engineering  and  statistical 
techniques  to  failure  rate  data,  the  program  provides  design  and  re¬ 
liability  enginee rs  with  ready  access  to  analyzed,  summarized,  and 


7-4 


AMCP  702-3 


descriptive  statistics  of  failure  rates  at  the  component/part  level. 

If  properly  applied,  the  information  will  provide  a  means  of  numeri¬ 
cally  assessing  the  probability  of  survival  (reliability)  of  an  item 
prior  to  or  simultaneously  with  the  construction  of  hardware.  As 
experience  in  the  use  of  this  method  is  gained,  refinements  can  be 
made,  and  improved  design  should  result.  In  detail,  the  program 
covers: 


(1)  Stress  analysis:  to  assist  designers  in  performing 
quantitative  reliability  stress  analyses  by  providing  operational  stress 
data  on  parts/components. 

(2)  Environmental  factors:  to  provide  data  on  various 
operating  modes  influencing  failure  rates  and  highlighting  the  critical 
functional  environmental  stresses  of  each  mode. 

(31  Application  factors:  to  provide  data  which  modify 
the  basic  failure  rate  in  order  to  allow  for  different  applications  of 
the  parts/components. 

(4)  Performance  degradation:  to  provide  data  on  stability 
or  degradation  of  parts/components  under  a  specific  set  of  application 
conditions. 

The  FARADA  Program  is  directed  by  the  Navy  and  is  administered 
and  implemented  by  the  U.  S.  Naval  Fleet  Missile  Systems  Analysis 
and  Evaluation  Group  (FMSAEG)  at  Corona,  California. 

d.  Inter-Service  Data  Exchange  Program.  (1'  IDEP  is  a 
tri  -service  program  for  the  exchange  of  part  test  reports  to  assist 
system  designers  in  the  selection  and  application  of  reliable  part 
types.  The  test  data  exchanged  includes,  but  is  not  limited  to,  that 
obtained  from:  qualification  or  certification  tests;  production  accept¬ 
ance  tests;  diagnostic  or  design  and  development  tests;  general  or 
comparative  evaluation  tests;  reliability,  exaggerated  stress,  and 
life  tests;  controlled  data  collection  and  sampling  programs. 

(2)  The  IDEP  exchange  program  does  not  summarize  or 
edit  test  reports;  instead,  the  three  distribution  centers  (one  for  each 
service)  act  as  clearing  houses.  Contractor  test  reports  are  for¬ 
warded  to  their  appropriate  service  distribution  center  where  they 
are  reproduced  and  forwarded  to  other  participants  in  the  program. 
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(3)  The  Army  IDEP  contact  is  IDEP  Office,  Redstone 
Scientific  Center,  U.  S.  Army  Missile  Command,  Redstone  Arsenal, 
Alabama. 

7-5.  Reports,  a.  Reports  are  the  products  resulting  from  the  data 
elements.  They  summarize  for  management  the  status  on  various 
system  parameters  such  as:  reliability,  availability,  maintainability, 
parts  usage  rates,  capability,  system  effectiveness,  etc. 

b.  Within  the  scope  of  official  guidelines,  the  procuring  agency 
has  freedom  of  action  for  developing  its  own  methods  to  meet  the  stated 
requirements,  as  well  as  the  restraints  imposed  on  it  by  resources, 
etc. 


c.  For  the  reliability  portion  of  the  program,  reliability  data 
files  should  be  established  for  Army  materiel  and  that  the  following 
technical  type  data  should  be  recorded  where  appropriate: 

(1)  Critical  design  or  manufacturing  features. 

(2)  Applicable  specifications  or  standards, 

(3)  Modes  of  failure. 

(4)  Causes  of  failure. 

(5)  Stresses  at  failure. 

(6)  Methods  of  detection  or  test, 

(7)  Type  of  failure  distributions. 

(8)  Recommended  necessary  preventive  or  corrective 

action. 

(9)  Estimate  of  reliability  for  various  applications. 

(10)  Prime  manufacturer  and  alternate  sources. 
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d.  The  above  technical  type  data  is  to  be  collected  during 
the  development  and  testing  phases.  Such  items  provide  the  quanti¬ 
tative  and  engineering  data  upon  which  a  decision  for  actions  may  be 
based. 


e.  In  addition  to  technical  type  data,  tactical  and  operational 
data  accumulation  is  required  and  should  be  organized  so  as  to  pro¬ 
vide  background  information  for  combat  development  purposes.  Speci¬ 
fic  items  of  data  must  be  patterned  according  to  the  nature  of  the  item. 
Where  appropriate,  the  data  should  include  information  concerning: 

(1)  Mission  reliability  with  respect  to  the  overall  mission 
assigned  to  the  field  unit. 

(2)  Reliability  data  for  tactically  or  operationally  sig¬ 
nificant  phases  of  the  overall  mission. 

(3)  Data  for  environmental  and  operational  conditions 
varying  from  the  normal. 

7-6.  Selection  of  data  elements  for  data  collection  forms,  a.  In 
selecting  or  developing  data  collection  forms  for  use  in  a  reliabili  ty 
program,  the  following  data  elements  are  suggested: 

( 1)  Using  unit. 

(2)  Equipment  identification  (aircraft  tail  number,  gun 
tube  number,  etc.  ). 

(3)  Data  of  failure. 

(4)  Identification  of  failure  (part  number,  subsystem,  etc.  ). 

(5)  Result  of  failure  (red-X,  mission  abort,  launch  hold, 
item  not  available,  etc.). 
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(6)  Total  system  time  (flight  hours,  equipment  hours,  miles, 
rounds  fired,  etc. ). 

(7)  Number  of  previous  failures  of  this  type  on  the  equipment. 

(8)  Time  to  each  previous  failure  of  this  type. 

(9)  Characteristic  of  the  failure  (cable  jammed,  receiver 
intermittent,  heavy  vibration,  out  of  specification  limits,  etc.  ). 

(10)  Environment  in  which  the  failure  occurred  (use  conditions). 

b.  It  should  be  kept  in  mind  that  the  above  list  of  elements  is  by  no 
means  complete.  However,  these  are  basic  to  reliability  analysis  and 
status  reporting.  In  order  for  a  reliability  program  to  effectively 
utilize  data  source  documents,  a  system  must  be  established  to  handle 
the  paper  flow  and  .-educe  it  to  a  compact  and  comprehensible  form. 

The  basic  requirement  is  to  determine  the  minimum  needed  data 
elements  and  then  synthesize  these  into  a  composite  torm  from  which  the 
required  reliability  analysis  and  reports  may  be  generated.  Obviously, 
an  alternative  to  using  established  forms  and  systems  is  to  develop  a 
data  collection  system  tailored  strictly  to  the  project.  The  latter 
method  is  probably  the  most  efficient,  relative  to  a  specific  project. 

Section  IV.  FEEDBACK  CYCLE 

7-7.  General,  a.  A  basic  failure  analysis  and  corrective  action  feed¬ 
back  loop  Bhould  determine:  what  failed;  how  it  failed;  why  it  failed; 
and  when  it  failed. 

b.  Failure  data  provides  information  to  determine  the  first  two 
factors.  The  third,  essential  to  corrective  action,  usually  requires 
information  which  can  be  obtained  only  by  laboratory  study  and/or 
engineering  analysis  of  the  problem  areas  uncovered  by  failure  analysis. 

c.  A  well  planned  failure  reporting  program  provides  important 
inputs  for  reliability  improvement.  Such  a  closed  loop  feedback  cycle 
is  illustrated  in  figure  7-1.  Data  collection  is  only  one  task  of  several 
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Figure  7-1 

Feedback  Cycle  for  Reliability 


7-9 


AMCP  702-3 


in  a  well  conceived  reliability  program  plan.  Contained  herein  are 
some  basic  requirements  of  a  data  collection  system,  data  sources, 
and  data  uses.  This  discussion  is  concerned  with  three  major  phases 
of  an  overall  program;  namely,  the  design  and  development  phase, 
the  manufacturing  or  production  phase,  and  the  operational  or  field 
evaluation  phase. 

7-8.  Design  and  development  phase  requirements,  a.  It  is  during 
this  phase  that  system  inherent  reliability  is  planned  and  established. 
Various  test  programs  are  conducted  at  this  time.  Examples  of 
these  tests  are  those  conducted  at  the  part  level,  breadboard  and 
prototype  assembly  and  subassembly  levels,  and  many  times,  at  the 
prototype  system  level. 

b.  Some  very  meaningful  reliability  data  results  from  initial 
tests  performed  in  the  engineering  laboratory  under  either  room 
ambient  or  controlled  environmental  conditions.  The  collection 
system  should  provide  for  the  routine  collection  of  these  data,  either 
by  completion  of  failure  report  forms  by  test  personnel,  or  by  lifting 
the  desired  data  from  the  test  logs  by  the  reliability  personnel,  or  a 
combination  of  both.  It  is  very  important  that  due  consideration  be 
given  to  the  total  planned  test  program  --  not  only  those  tests  that 
are  to  be  performed  during  the  design  and  development  phase,  but 
for  all  phases  of  the  overall  program  as  sources  for  reliability  data. 

It  is  at  the  beginning  of  a  proposed  program  that  the  reliability 
engineers  should  plan  and  coordinate  with  other  activities  for  their 
total  data  needs  and  the  manner  in  which  these  data  will  be  time 
phased  as  inputs  for  use  during  the  performance  of  the  other  relia¬ 
bility  tasks. 

7-9.  Manufacturing  or  production  phase  requirements,  a.  As 
sources  of  data,  the  procuring  agency  reliability  personnel  should  look 
to  the  areas  and  agencies  responsible  for  the  preservation  of  reliability; 
namely,  manufacturing  (production),  handling,  storage,  maintenance, 
and  test. 


b.  Thus,  data  gathered  can  be  separated  into  broad  categories 
as  quality  data  and  reliability  data.  Quality  data  includes  records  of 
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inspection  and  testing;  e.  g.  ,  go  no-go  tests,  measurements  of  vari¬ 
ables  such  as  resistance  and  capacitance  to  determine  conformance 
to  established  technical  requirements  contained  in  specifications, 
drawings,  and  purchase  orders.  Reliability  data  on  equipment  is 
developed  during  preproduction  stages  in  order  to  detect  equipment 
weaknesses  before  release  to  production  and  to  obtain  a  quantitative 
estimate  of  equipment  reliability.  Reliability  data  on  parts  and/or 
components  is  developed  during  the  production  stages  to  assure  that 
the  equipment  inherent  reliability  is  not  unduly  degraded  by  manu¬ 
facturing  processes.  When  the  data  indicates  excessive  failure  rates, 
corrective  action  should  follow. 

7-10.  Operational  or  field  evaluation  phase  requirements.  a.  Ob¬ 
taining  timely,  accurate  and  complete  reliability  data  from  the  field 
is  probably  the  most  difficult.  People  who  are  more  concerned  with 
getting  the  equipment  to  function  (their  prime  mission)  may  be  lax  in 
reporting  data  (failure  and  success).  An  initially  well  conceived  data 
collection  plan  which  is  properly  coordinated  should  reduce  data 
collection  to  a  routine  activity. 

b.  Data  sources  include  operational  logs,  contractor's  report 
forms,  and  reports  associated  with  the  Army  equipment  failure  report¬ 
ing  system. 

c.  The  types  and  evaluation  of  field  failure  and  repair  data  are 
much  the  same  as  those  for  other  phases  of  the  equipment  life  cycle. 
However,  greater  emphasis  is  given  to  operational  malpractices  and 
incompatibility  between  mplant  performance  specifications  and  opera¬ 
tional  specifications.  During  the  operational  phase  of  a  given  program, 
the  reliability  engineer  should  be  exerting  a  great  deal  of  effort  to 
uncover  the  causes  for  equipment  and  system  unreliability  by  searching 
out  both  quantitative  and  qualitative  information  pertaining  to  failures. 

Section  V.  STEPS  FOR  UTILIZATION  OF  FAILURE  DATA 

7-11.  Procedural  steps.  Of  the  many  questions  which  may  be  asked  of 
a  failure  reporting  system,  and  among  the  most  useful  when  answered,  is: 
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What,  within  an  equipment,  contributes  most  to  its  unreliability?  The 
following  represents  a  step  by  step  approach  for  analyzing  present 
failure  reports,  whether  originating  in  the  field,  at  a  test  facility,  or 
in  a  contractor’s  plant,  designed  to  answer  this  question. 

a.  Step  1,  Organize  the  data.  Reliability  data  should  be  evalu¬ 
ated  at  planned  periods  throughout  the  program  and  should  be  tailored 
to  each  specific  phase.  A  reliability  data  center  is  useful  in  the 
realistic  assessment  of  current  reliability  levels.  It  is  a  tool  which 
enables  failure  data  to  be  used  in  indicating  where  design  improvement 
and  support  is  needed  and  is  a  necessary  storehouse  of  vital  informa¬ 
tion  to  be  used  in  engineering,  manufacturing,  quality,  and  service 
activities.  Here,  the  data  is  generally  arranged  first  by  identifiable 
subassemblies  within  the  subject  equipment;  then  by  subsystem  or  part 
reference  designation.  (This  step  is  easily  accomplished  by  machine 
sorting  of  data  when  information  is  transcribed  on  punched  cards  or 
tape.  ) 

b.  Step  2,  Frequency  analysis.  The  data  center  can  be  inter¬ 
rogated  to  provide  failure  data;  failure  times;  accumulated  operating 
time  on  the  system  or  equipment;  and  total  accumulated  number  of 
failures  for  a  selected  subsystem,  assembly,  or  component.  Con¬ 
tinuous  updating  of  reports  will  provide  continuous  management 
visibility  of  the  reliability  program.  Information  may  be  arranged  as 
to  frequency  of  failure  occurrence  vs.  subsystem  for  the  purpose  of 
identifying  those  subsystems  causing  the  most  trouble.  This  proce¬ 
dure  can  then  be  repeated  through  descending  levels  to  identify  most 
troublesome  assemblies,  components,  or  parts. 

c.  Step  3,  Selection  of  vital  failures.  Failure  types  considered 
vital  should  be  sought  and  can  be  recognized  as  those  failure  modes, 
failure  parts,  and  problem  areas  to  which  reliability  improvement 
effort  can  be  profitably  applied.  Specific  components  and  subsystems 
which  fit  into  this  category  are: 

(1)  Those  whose  failure  markedly  affects  the  safety  of  the 
system  both  in  terms  of  human  safety  and  equipment  destruction. 
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(2)  Those  which  appear  in  large  numbers  in  the  system. 

(3)  Those  whose  failure  results  in  high  support  costs. 

(4)  Those  whose  reliability  level  is  relatively  low  with 
respect  to  the  rest  of  the  system. 

d.  Step  4,  Problem  evaluation.  Identification  of  vital  failures 
within  troublesome  subsystems,  assemblies,  etc.,  is  not  enough  to 
satisfy  the  requirement  for  a  sound  reliability  intelligence  system. 
Corrective  action  can  only  be  accomplished  if  the  cause  can  be  deter¬ 
mined.  This  is  an  engineering  job  consisting  of  such  things  as  quality 
audits,  laboratory  tests,  engineering  evaluation,  etc.  It  is  through 
these  methods,  coupled  with  the  routine  observation,  interview,  and 
data  evaluation,  that  failure  causes  can  be  isolated  and  necessary  cor¬ 
rective  action  initiated. 

e.  Step  5,  Determine  corrective  action.  Corrective  action 
must  be  carried  out  with  the  objective  of  providing  a  design  change  or 
modification  which  mitigates  the  causes  of  failure.  In  generating  a 
technique  for  handling  corrective  action,  prime  consideration  should 
be  given  to  a  system  which  would  prevent  discrepancies  from  escaping 
detection,  tap  the  many  available  sources  of  data,  and  be  rapid  and 
comprehensive  in  its  closure  action.  Figure  7-2  is  a  schematic  of  a 
typical  corrective  acfion  system.  All  changes,  including  corrective 
actions,  shall  undergo  enginee  ring  -  reliability  analysis.  This  approach 
is  applicable  to  all  phases  of  the  life  cycle. 

f.  Step  6,  Implement.  Implementation  of  corrective  action 
involves  the  developing  of  a  new  design  or  modification  of  an  existing 
design  within  a  system.  Once  the  problem  area  has  been  recognized 
and  defined,  the  cause  identified,  and  corrective  accion  initiated, 
there  must  be  a  means  for  implementing  this  change  in  the  program. 
This  implementation  can  be  accomplished  in  many  ways,  such  as: 
procedures,  engineering  change  proposals  (ECP),  or  modification 
work  orders  (MWO).  A  point  to  remember  is  that  implementation 
must  take  place  in  a  ‘■imely  manner  in  order  for  it  to  be  effective. 

This  action  complete  the  cycle  for  a  closed  loop  feedback  system. 
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g-  Step  7,  Follow-up.  The  approach  illustrated  in  the  pre¬ 
ceding  steps  will  be  useful  and  effective  only  if  changes  conceived, 
tested,  and  introduced  into  existing  systems  or  used  to  develop  new 
systems  are  evaluated  and  monitored  to  assure  compliance  with  the 
intent.  Follow-up  should  also  provide  checks  to  determine  whether 
the  problem  has  been  eliminated,  and  review  to  see  whether  new  prob 
lems  have  been  introduced  as  a  result  of  the  corrective  action. 


Figure  7-2 

ical  Corrective  Action  Flow  Process 
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APPENDIX  A 

CONCEPTS  OF  RELIABILITY  QUANTIFICATION 
Section  I.  INTRODUCTION 


A-l.  General.  Quantitative  expression  and  measurement  of  relia¬ 
bility  requires  an  understanding  of  the  concepts  of  probability  and 
statistics.  Probability  serves  as  a  measurement  scale  by  which  relia¬ 
bility  is  expressed  and,  as  such,  is  a  measure  of  the  likelihood  or  chance 
that  an  item  will  survive  a  required  mission  time  for  a  specified  intended 
function  and  use  environment.  This  appendix  reviews  a  few  basic  rules, 
symbols,  and  concepts  necessary  for  quantification  of  reliability.  The 
review  does  not  constitute  an  exhaustive  coverage  of  the  necessary  mate¬ 
rials.  Further  coverage  may  be  found  in  various  textbooks,  professional 
journals,  etc. 


Section  II.  PROBABILITY 

A-2.  Definition,  a-  In  general,  the  probability  that  an  event  A  wiil 
happen  is  the  portion  of  time  the  event  will  occur  over  a  large  number 
of  trials.  When  only  a  Single  trial  is  to  be  encountered,  the  probability 
that  event  A  will  happen  is  merely  the  relative  chance  of  its  happening. 

b.  The  statement  which  follows  provides  a  more  formal  defi¬ 
nition  of  probability.  Given  an  experiment,  if  an  event  may  happen 
in  "a1'  ways  and  fail  to  happen  in  "b"  ways,  and  all  of  these  ways  are 
mutually  exclusive  and  equally  likely  to  occur,  the  probability  of  the 
event  happening  is 


a 

a+b 

i.e.  ,  the  ratio  of  the  number  of  favorable  ways  to  total  number  of  ways 
the  event  can  happen.  Symbolically,  the  probability  that  the  event  A 
will  happen  is  expressed:  P(A). 


c.  The  numerical  expression  of  probability  operates  along  a 
dimensionless,  continuous  scale  extending  from  0  to  1.  If  P(A)  =  0, 
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the  event  A  will  not  happen.  If  P(A)  =  1,  the  event  A  will  always  happen. 
If  F(A)  =  .5,  the  event  A  would  be  expected  to  occur  in  50%  of  a  large 
number  of  trials.  In  general,  high  frequency  events  will  be  assigned  a 
probability  value  near  one,  and  low  frequency  events  will  be  assigned  a 
probability  value  near  zero. 


d.  To  illustrate  the  definition  of  probability,  consider  an  ex¬ 
periment  consisting  of  a  single  toss  of  an  "honest"  die.  Find  the  prob¬ 
ability  that  the  upturned  face  will  show  an  odd  number. 


P(odd  number) 


Total  number  possible  outcomes 
resulting  in  odd  number 
Total  number  possible  outcomes 


3 

6 


1 

-> 


This  means  that  in  a  large  number  of  tosses,  about  half  of  the  tosses 
would  result  in  an  odd  number.  The  interpretation  for  a  single  toss 
is  that  there  is  a  50-50  chance  that  the  outcome  would  be  odd. 

A-3.  Concept  of  a  set,  a.  General.  A  brief  investigation  of  set 
notation  and  operation  will  facilitate  the  discussion  of  probability. 

A  set  is  defined  as  a  collection  of  objects  having  certain  specified 
properties.  Each  object  belonging  to  the  set  is  called  an  element. 

The  set  that  contains  the  totality  of  all  elements  that  may  appear  in 
our  investigation  is  called  a  space.  A  space  has  neither  dimension 
nor  volume,  but  is  comprised  of  a  complete  set  of  elements. 

b.  Definitions  of  specific  sets. 

(1)  Infinite  set.  Set  having  an  infinite  number  of  elements. 

(2)  Finite  set.  Set  having  a  finite  number  of  elements. 

(3)  Empty  set.  Set  having  no  elements. 

(4)  Subset.  Set  consisting  of  several  elements  of  another 
set.  A  subset  is,  of  course,  a  set  and  the  operations  on  sets  will  be 
applicable  to  subsets. 
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c.  Examples  of  sets  and  subsets.  The  set  of  all  prime  num¬ 
bers  is  (1,  2,  3,  5,  7,  11,  •  ■  •  This  is  an  infinite  set.  The  set  of 
all  planets  is  (Earth,  Mars,  Jupiter,  Venus,  Pluto,  Saturn,  Mercury. 
Neptune,  Uranus).  This  is  a  finite  set  with  nine  elements.  The  set 
of  all  prime  numbers  less  than  11  is  (1,  2,  3,  5,  7).  This  is  a  finite 
set  and  a  subset  of  all  prime  numbers.  The  set  of  all  integral  quotients 
greater  than  one  obtained  from  dividing  the  prime  numbers  by  3  will 
contain  no  elements,  i.  e.  ,  is  the  empty  set.  The  set  of  all  elements 
on  the  real  line  between  0  and  1  is  an  infinite  set.  This  infinite  set  is 
called  a  non-countable  infinite  set.  The  infinite  set  typified  by  the  prime 
numbers  is  called  a  countable  infinite  set. 

d.  Operations  on  sets. 

(1)  Let  a  space  S  be  given  and  consider  various  sets  in  S- 
Let  A  and  B  be  the  subsets  of  S.  This  may  be  written 

ACS,  B  C  S 

which  is  read:  the  set  A  is  contained  in  the  set  Si  the  set  B  is  contained 
in  the  set  S. 


(2)  The  set  A  U  B  called  the  union  of  A  and  B  is  the  set 
of  all  elements  belonging  to  at  least  one  of  the  sets  A  and  B.  To  help 
in  visualizing  these  operations,  Venn  diagrams  will  be  used  for  illus¬ 
tration.  The  rectangle  represents  the  space  S,  and  the  circles  represent 
the  sets  A  and  B.  In  figure  A-l,  the  shaded  area  represents  the  union 
of  A  and  B. 


Figure  A-l 
Union  of  A  and  B 


A- 3 


AMCP  702-3 


(3)  The  set  A  ll  B  or  AB,  ^  called  the  intersection  of  A 
and  B,  is  the  set  of  all  elements  belonging  to  both  the  sets  A  and  B. 
In  figure  A-2,  the  shaded  area  represents  the  intersection  of  A  and 

B. 


(4)  The  difference  of  A  a.  d  B,  designated  by  A  is  the 
set  of  all  elements  that  belong  to  A  but  not  to  B.  In  figure  A-i  the 
shaded  area  represents  the  set  A-B. 


Figure  A-2 
Difference  of  A  and  B 


*  Af\B  and  AB  are  used  interchangeably  in  this  document. 
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(5)  The  set  A,  called  the  complement  of  A,  is  the  set  of 
all  elements  in  S  that  are  not  contained  in  A.  The  complement  of  A 
is  represented  in  figure  A-4  by  the  shaded  area. 


Figure  A-4 
Complement  of  A 

(6)  The  following  example  illustrates  the  union,  intersection, 
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A-4.  Probability  function.  a.  In  connection  with  a  random  phenomenon 
or  a  real  or  conceptual  experiment,  there  will  be  certain  possible  out¬ 
comes.  If  the  experiment  is  repeated  under  identical  (or  more  practically, 
under  nearly  identical)  conditions  and  the  outcomes  are  recorded,  intuition 
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tells  us  that  relative  frequency  of  the  possible  outcomes  will  tend  to 
a  fixed  value  after  a  large  number  of  repetitions.  These  considerations 
lead  us  to  assign  a  number  (weight  or  measure)  to  the  random  outcomes 
and  to  talk  of  the  probability  of  an  outcome. 

b.  Define  a  sample  space  S  as  the  set  of  all  possible  outcomes 
of  an  experiment  or  random  phenomenon,  and  the  probability  of  an 
outcome  as  a  rule  that  assigns  a  real  number  to  each  element  of  the 
sample  space.  A  sample  space,  together  with  the  assignment  of  prob¬ 
ability  numbers  is  called  a  probability  space.  An  event  is  defined  as 

a  subset  of  a  sample  space,  i.e.  ,  a  definite  collection  of  sample  points. 
The  event  A  is  said  to  have  occurred  on  a  trial  of  the  experiment  if 
the  experiment  results  in  an  outcome  that  is  one  of  the  sample  points 
of  A.  There  clearly  are  many  possible  events  associated  with  an  ex¬ 
periment  (i.e.  ,  sample  space).  The  aggregate  of  all  subsets  of  S,  plus 
the  unions,  differences,  intersections  and  complements  of  these  sub¬ 
sets,  are  the  events  associated  with  an  experimen.. 

c.  We  define  then  the  probability  function  as  a  rule  or  function 
that  assigns  a  real  number  to  each  element  of  a  set  of  objects,  (i.  e.  , 
the  outcomes  of  an  experiment).  The  probability  of  an  event  A,  called 
P(A),  is  defined  to  be  the  sum  of  the  numbers  (or  weights)  assigned 

to  each  of  the  sample  points  contained  in  A.  Some  basic  properties  of 
the  probability  function  follow. 

(1)  0  <  P(A)  <  1 

(2)  P(A)  =  1  if  A  =  S.  In  other  words,  if  A  is  the  set 
of  all  possible  outcomes,  then  the  occurrence  ox  une  of  the  elements 
of  A  is  certain. 

(3)  P(A)  =  0  if  A  is  the  empty  or  null  set,  denoted  by 
This  implies  that  the  set  A  contains  none  of  the  possible  outcomes  of 
the  experiment;  hence,  the  occurrence  of  an  element  of  A  is  impossible. 

(4)  P(A)  =  l-P(A).  This  is  known  as  the  complementation 

principle. 

(5)  P(A  U  B)  =  P(A)  +  P(B)-P(A  f)  B)  for  every  pair  of  events 

A,  B. 
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d.  In  many  probability  situations  when  the  outcomes  of  a  ran¬ 
dom  phenomenon  are  finite  in  number  and  the  outcomes  are  equally 
likely,  we  assign  equal  probabilities  to  the  possible  outcomes.  For 
example,  in  the  experiment  of  tossing  a  coin,  S  =  (H,  T),  the  possible 
outcomes  are  heads  and  tails  and  each  is  equally  likely  and  has  prob¬ 
ability  1/2.  In  general,  if 

S  =  Aj  1>A2  U  A3  U-  ■  ■  U  Ar  where  A.fl  A.  =  4> 
and  the  probability 

P(Aj )  =  P(AZ)  =  ...  =  P(Ar),  then  P(A.)  =  1/r. 

For  any  event  E  =  AjU  A^  U-.-  u  Ak  where  k  <  r  and  Ax  f)  A:  =  4> » 
the  probability  of  E  is 

P(E)  =  P(A{)  r  P(A2)  +  •••+  P(Ak) 


Sometimes  probability  is  defined  uring  this  concept  where  k  is  the  num¬ 
ber  of  equally  likely  ways  favorable  to  the  event  E  and  r  is  the  total 
number  of  possible  outcomes  of  the  experiment  or  random  phenomenon. 
The  probability  of  the  event  E  is  defined  as  the  ratio  k/r. 

e.  To  exemplify  the  assignment  of  probabilities,  consider 
an  experiment  consisting  of  tossing  a  coin  twice.  The  sample  space 
S  13  defined  as  S  =  'HT,  HH,  TH,  TT),  consisting  of  four  outcomes 
where  HT  denotes  heads  on  the  first  toss  and  tails  on  the  second,  and 
so  forth.  Since  each  is  equally  likely,  we  might  assign  the  numbers 
l/4,  1/4,  1/4,  1/4  to  each  of  these  sample  points. 

(1)  Let  E  =  event  of  a  head  on  the  first  toss 
P(E}  =  P(HT)  +  F{HH) 

=  1/4  +  1/4  =  2/4 
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(2)  Let  =  event  head  on  first  toss 

E2  =  event  tails  on  second  toss 

Ej  =  (HH,  HT)  =  2/4 

E2  =  (HT,  TT)  P(E2)  =  2/4 

=  (HT)  P(Ej  E2)  =  1/4 

To  determine  probability  of  EjU  E^.  we  sum  the  probabilities  of  each  of 
the  sample  points  favorable  to  event  Ej  U  E^  . 

Ej'J  E2  =  (HH,  HT,  TT)  and  P(E1  U  E2)  =  1/4  +  1/4  +  1/4  =  3/4  ; 

or,  using  the  relationship, 

P(E1  U  E2)  =  P(Ej)  +  P(E  )  -  P(E1E2)  *  2/4  +  2/4  -  1/4  =  3/4. 

A-5.  Independent  and  dependent  events.  a.  Conditional  Probability. 
Given  two  events,  A  and  B,  the  conditional  probability  of  the  event  B, 
given  the  event  A,  denoted  by  P(B/A),  means  the  probability  that  B  will 
occur  knowing  that  the  event  A  has  already  occurred  (or  will  occur). 

This  probability  is  defined  as 

P(B/A)  = 

P(A) 

This  definition  has  intuitive  appeal  as  may  be  seen  trom  the  Venn  diagram 
in  figure  A-5. 


Illustration  of  Conditional  Probability  Relationship 
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(1)  Knowing  that  the  event  A  has  occurred,  our  attention 
is  turned  to  the  set  A.  The  '■lements  in  A  favorable  to  the  event  B 
is  the  set  AB,  represented  by  the  shaded  area.  The  set  A  may  now 
be  considered  in  a  sense  our  sample  space,  and  the  set  AB,  the  set  in 
A  favorable  to  the  event  B.  Therefore,  the  probability  of  the  event 
B/A  is  given  by  the  ratio  of  the  two  probabilities,  P(AB)  and  P(A). 


(2)  N  ite  that  this  form  also  defines  the  joint  probability 
of  the  event  AB. 


P(AB)  =  P(A)P(B/A)  =  P(B)P(A/B) 

(3)  For  example,  consider  the  problem  of  drawing  without 
replacement  samples  of  size  2  from  an  urn  containing  3  white  and  2 
red  balls.  Let  A  be  the  event  the  first  ball  drawn  is  white  and  B  the 
event  the  second  ball  drawn  is  white.  Determine  P(B/A)  the  probability 
the  second  ball  drawn  is  white  given  the  first  ball  drawn  is  white.  By 
definition, 

P(B/A)  =  „  . 

P(A) 

Three  outcomes  are  favorable  to  the  event  AB,  namely  (w^.w^), 

(w,,w,),  where  w.  is  white  ball  i.  Since  there  are  5  '  -  JL' _  _  in 

131  \2/  2  fTT  “ 

possible  outcomes,  we  assign  the  vaiue  1/10  to  each  outcome  and, 

hence  P(AB)  =  3/10.  Relating  the  event  A  =  (w^w^.w^)  to  the  5  possible 

outcomes  of  the  first  draw  gives  P(A)  =  3/5.  Thus,  P(B/A/  =  {3/ 1 0) / (3/5 )=1 /2. 

b.  Independence.  Let  A  and  B  be  events  defined  on  the  same 
probability  space.  The  events  A  and  B  are  defined  to  be  independent  if 

P(AB)  =  P(A)P{B) 


Events  that  do  not  satisfy  the  above  relation,  nip  are  said  to  be  dependent. 
The  concepts  of  independence  and  conditio  il  probability  may  be  defined 
for  n  events 

A. ,  A« ,  *  *  •  ,  A  . 

12  n 
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The  conditional  probability  of  given  that  the  events  Aj,  A^»  *  • ' ,  A^ 
have  occurred  is  given  by 


p(An/ Al*  A2' 


'  A-  i  )  =  P<A1»  AZ>  A3; 

p(Al.  a2*  An-1 ) 


and  the  n  events  are  mutually  independent  if 


P(AiAj)  =  P(Ai)P(Aj) 

P(AiAjAk)  =  P(Ai)P(Aj)P(Ak) 

P(A1A2*  •  *An)  =  P(A1)P{A2)-  •  •  P(A„) 
for  all  combinations  1  <  i"  j  _  k  •  *  •  <  n. 

A-6.  Basic  rules  of  probability.  Certain  basic  rules  of  probability 
Avill  be  useful  for  reliability  analysis  activities.  Some  of  these  follow. 

a.  Multiplication.  (1)  Consider  two  events  A  and  B  with  re¬ 
spective  probabilities  of  occurrence  of  P(A)  and  P(B).  Then  the  prob¬ 
ability  of  occurrence  of  both  A  and  B  is 

P(A  flB)=  P(AB)  =  P(A)P(B/ A ) 

=  P(B)P(A/B) 

(a)  To  illustrate  the  above  relationship,  consider 
drawing  two  cards  (without  replacement)  from  a  well-shuffled,  52-card 
deck.  What  is  the  probability  that  both  cards  will  be  aces? 

(b)  Let  A  be  the  event  of  an  ace  on  the  first  draw  and 
B  the  event  of  an  ace  on  the  second  draw.  Then 

P(A)  =j~  and  P(B  / A)  -  ~~ 

P(AE)  =  P(A)P(B/A)  =  —■  •  ^  =  To T 

T>  C  O  X  LjL  X 
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(2)  If  the  events  A  and  B  are  independent,  the  above  re¬ 
lationship  reduces  to 

P(AB)  =  P(A  fl  B)  =  P(A)P(B) 


because 


P(B/A)  =  P(B)  and  P(A/B)  =  P(A). 

Then  A  and  B  are  defined  as  statistically  independent  events. 

(a)  To  illustrate  this  special  case,  consider  an  elec¬ 
tronic  assembly  consisting  of  two  independent  subsystems:  A  and  B, 
functionally  connected  in  series.  Both  subsystems  must  function  properly 
in  order  for  the  system  to  function  properly.  Suppose  that  the  probabil¬ 
ity  of  A  working  properly  =  0.9  and  that  the  probability  of  B  working 
properly  =  0.  8.  Compute  the  probability  that  the  system  will  function 
properly. 


P(A)  =  0.  9  and  P(B)  =  0.  8 

(b)  The  event  that  the  system  will  work  properly  is  the 
intersection  of  A  and  B. 

P(AB)  =  P(A)P(B)  "  (0.  9)(0. 8)  =  0.  72 

b.  Addition.  (1 )  The  probability  that  at  least  one  of  two  events, 
A  and  B,  occurs,  (i.  e.  ,  either  A  or  B  or  both)  is 

P(A  0  B)  =  P(A)  +  P(B)  -  P(AB) 
where  A  U  B  is  defined  as  A  union  B. 

(a)  For  example,  a  certain  operation  can  be  performed 
by  either  one  of  two  systems,  A  and  B.  A.sumo  that  the  systems  A  and 
B  operate  completely  independently  and  that  the  probability  of  A  function¬ 
ing  properly  is  0.  8  and  that  the  probability  of  B  functioning  properly  is 
0.7.  Compute  the  probability  that  the  operation  is  performed  success¬ 
fully  by  at  least  one  of  the  two  systems,  A,  B,  Then  P(A)  =  0.8  and 
P(B)  =  0.  7. 
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(b)  The  event  that  the  system  will  work  properly  is 
the  union  of  A  and  B  and 

P(aUb)  =  P(A)  =  P(B)  -  P(AB)  =  0.  8  +  0.  7  -  (0.  8)(0.  7)  =  0.  94. 

(2)  If  A  and  B  are  mutually  exclusive,  i.  e.  ,  P(AB)  =  0, 
the  above  relationship  becomes 

P(AtJ  B)  =  P(A)  +  P(B) 

( 3 }  To  illustrate,  consider  drawing  one  card  from 
a  well-shuffled  deck.  Find  the  probability  of  that  card  being  either  a 
club  or  a  diamond.  Let  A  =  the  event  of  a  club  and  B  -  the  event  of  a 
diamond. 


(b)  Then  P(A)  =  —  ,  P{B)  =  —  and  P(AB)  =  0  ; 

52  52 

i.  e.,  A  and  B  are  mutually  exclusive. 

P(A  U  B)  =  P(A)  +  P(B)  =  +  ||  =  |~ 

c.  Complementation.  (1)  The  last  of  the  probability  relation¬ 
ships  to  be  discussed  at  thi'  time  is  that  of  complementation.  If  P(A) 
is  the  probability  that  the  event  A  will  occur,  then  P(X)  is  the  probabil¬ 
ity  that  the  event  A  will  not  occur,  and 

P(A)  +  P(A)  =  1 


(2)  To  illustrate,  consider  the  toss  of  a  single  die.  Let 
A  be  the  event  of  a  six  appearing  and  A  the  event  of  a  six  not  appearing. 

Th6n  1  -  5  -  1  5 

P(A)  =  ~  and  P(A)  =  f-  and  P(A)  +  P(A)  =  ~  +  ~  =  1  . 

0  6  DO 

d.  Summary  of  probability  rules. 


(1 )  Multiplication  of  probabilities  when  events  are  not 
independent;  conditional  probabilities.  If  E  and  F  are  not  independent. 
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(i.  e.  ,  occurrence  of  event  E  affects  the  probability  ol  the  occurrence 
of  event  F),  then  the  probability  of  the  joint  occurrence  of  E  and  F  is 
given  by 


P(E  (1  F)  -  P(E)P(F/E)  =  P(F)P{E/F) 

(2)  Multiplication  of  probabilities  for  independent  events. 

If  E  and  F  are  independent,  (i.e.,  the  occurrence  of  E  does  not  affect 
the  occurrence  of  F),  then 

P(E  F)  =  P{E)P(F) 

(3)  Addition  of  probabilities  when  events  are  not  mutually 
exclusive.  If  E  and  F  are  events  which  are  not  mutually  exclusive, 

(i.e.  ,  events  E  and  F  can  happen  together),  then  the  probability  of 
the  occurrence  of  E  or  F  is  given  by 

P(E  'J  F)  =  P(E)  +  P(F)  -  P(EP  F) 

(4 )  Addition  of  probabilities  for  mutually  exclusive  events. 

If  two  events  E  and  F  are  mutually  exclusive,  (i.  e.  ,  they  cannot  happen 
together),  then 

P(E  U  F)  =  P(E)  +  P{F ) 

(5)  Complementation.  Suppose  E  is  an  event,  then 

P(E)  =  1  -  P(E). 

Section  III.  STATISTICS  AND  PROBABILITY  DISTRIBUTIONS 

A-7.  General.  Statistics  has  sometimes  been  defined  as  the  collection, 
analysis  and  p:  esenration  of  numerical  data.  Numerical  expression  of 
reliability  requires  a  basic  understanding  of  certain  statistical  methods, 

A-8.  Basic  descriptive  statistics,  a.  There  exist  certain  character- 
tics  which  may  be  used  to  describe  a  group  or  population  of  numerical 
data.  Basic  descriptive  characteristics  to  be  considered  herein  are 
central  tendency,  variability  and  shape  of  the  data  distribution.  Central 
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tendency  has  to  do  with  location  of  the  data  on  the  measurement  scale. 
Variability  pertains  to  the  dispersion  of  the  data  values.  Shape  has  to 
do  with  the  pattern  of  data  variability.  Each  of  these  characteristics 
has  its  own  effect  on  reliability  measurement. 

b.  To  illustrate  the  meaning  of  these  descriptive  characteristic 
consider  the  following  failure  times  which  resulted  from  a  hypothetical 
life  test  of  '00  items  (figure  A-6). 
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Figure  A-6 
Failure  Times 


c.  These  data  have  beer  grouped  to  form  a  frequency  table 
(figure  A-7). 
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Interval 

Frequency 

Relative 

Frequency 

Cumulative 

Relative 

Frequency 

4.5-  9.5 

1 

.01 

.01 

9.  5-14.5 

1 

.01 

.02 

14.  5  -  19.  5 

4 

.  04 

.06 

19.  5  -  24.  5 

12 

.  12 

.  18 

24.  5  -  29.  5 

15 

.  15 

.  33 

29.  5  -  34.  5 

14 

.  14 

.  47 

34.  5  -  39.  5 

21 

.21 

.  68 

39.  5  -  44.  5 

15 

.  15 

.  83 

44.  5  -  49.  5 

10 

.  10 

.  93 

49.  5  -  54.  5 

3 

.03 

.96 

54.  5  -  59.  5 

3 

.03 

.99 

59-  5  -  64.  5 

0 

0 

.99 

64.  5  -  69.  5 

1 

.01 

1. 00 

Figure  A-7 
Frequency  Table 

d.  The  relative  frequency  histogram  (figure  A-8)  provides  a 
pictorial  approach  to  describing  the  population  of  failure  times  and  the 
way  they  are  distributed  along  the  measurement  (time)  scale.  With 
reference  to  central  tendency,  the  data  appears  to  be  clustered  about 
the  interval  34.  5-39.  5  hours.  Inspection  of  the  histogram  provides 

a  pictorial  indication  of  the  amount  of  variability  in  the  data  as  well 
as  the  shape  or  pattern  of  variability, 

e.  For  purposes  of  making  probability  statements  about  failure 
time,  tl»e  vertical  scale  of  the  relative  frequency  histogram  may  be 
modified  in  such  a  manner  that  the  total  area  of  the  histogram  is  unity. 

In  this  case,  the  vertical  scale  must  be  divided  by  5.  We  shall  refer  to 
the  resulting  diagram  as  a  relative  frequency  density  histogram  (figure 
A- 9).  Then  the  portion  of  the  failure  times  falling  in  a  particular  interval 
is  merely  the  area  of  that  interval. 
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f.  Three  quantitative  measures  of  central  tendency  (mean, 
median  arid  mode)  are  defined  here. 

(1)  The  mode  is  that  value  which  occurs  most  frequently. 

(2)  The  median  is  defined  as  the  middlemost  value,  i.e.- 
that  value  above  which  (and  below  which)  50%  of  the  observations  fall. 
Finding  the  median  of  a  group  of  data  involves  ordering  the  observations 
from  smallest  to  largest  and  counting  to  the  middle  value. 

(3)  The  mean  or  arithmetic  average  is  the  measure  of  cen¬ 
tral  tendency  with  which  we  shall  be  concerned  herein.  The  mean  {  ,  )  is 

;r  =  T,  •x 

n 

where  n  is  the  number  of  observations;  £  x  is  the  sum  of  the  n  observa¬ 
tions.  For  the  data  given  in  figure  A-l,  the  sum  of  the  100  observations 
is  T;  x  =  3475.  Then  the  mean  of  this  data  i9 

X  =  -A*-  -  =  34.  75 

n  100 

g.  The  measure  of  variability  which  will  be  most  useful  in 
reliability  analysis  is  the  standard  deviation  (  r). 

„  -  !  nD  xZ  -  (  Sx)2 

"  v  - ^ - 


where 

n  is  number  of  ob*,''“-'Mions 
Ex  i.;  the  sum  of  the  observation  values 
fix2  is  the  sum  of  squared  observation  values 


for  the  data  in  figure  A-l,  Tlx^  =  131801  and  the  standard  deviation 

becomes  I  _ 

!  100(131801)  -  (3475)2  -  ,  „  &l 

100(100) 
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h.  The  shape  character  is t ’  is  not  ea  sily  quantified.  The 
density  histogram  (figure  A-9)  provided  a  visual  description  of  the 
shape  of  data.  Sometimes  a  mathematical  equation  can  be  identified 
to  serve  as  a  model  for  the  shape  or  pattern  of  variability  for  a  par¬ 
ticular  group  of  data.  For  example,  the  normal  density  function 


f(x)  = 


-  n  \Z  1 


is  often  useful  as  a  model.  Figure  A-10  shows  this  function  (solid 
line)  plotted  along  with  the  density  histogram  for  the  data  in  figure 
A-l.  pander  vaiues  were  34.75  and  10.5  1  hours,  respectively,  as 
found  in  preious  calculations.  It  seems  that  the  normal  probability 
density  function  provides  a  good  model  describing  the  distribution  of 
data  values  along  the  time  scale  for  this  particular  group  of  -lata. 
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Figure  A-10 

Normal  Density  Function  vs. 
Relative  Frequency  Density  Histogram 
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i.  In  general,  a  probability  density  function,  denoted  as  f(x), 
serves  as  a  model  relating  the  outcomes  of  a  random  variable  (X)  to 
probability  statements.  At  this  time,  lor  purposes  of  illustration,  con¬ 
sider  the  random  variable  X  to  be  the  failure  time  for  an  item.  For 
example,  P(A  _  X  _  B)  is  merely  the  area  under  the  densitv  umction 
between  the  points  A  and  B  as  illustrated  by  the  shaded  area  in  figure 
A-  1 1 . 


HOURS  (*) 


F igure  A-  1  1 

Probability  ol  a  Failure  Time  Between  A  and  B 

j.  Another  function  of  interest  in  reliability  analysis  is  the 
distribution  function  F(x)  where 


F (x)  =  P(X  _  x) 

Tr.  --.ther  words,  F(x)  is  the  probability  that  a  fat*-  ‘  e  time  will  be  less 
than  a  specified  time  x  and  is  represented  as  the  area  under  the  density 
function  for  values  less  than  x  on  the  horizontal  scale  (figure  A- 12). 
When  evaluated  for  all  x,  F(x)  for  the  norn  ul  model  fitting  the  data  in 
figure  A-i  becomes  as  shown  in  figure  A-13  (solid  line). 
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Figure  A- 12 

Probability  of  a  Failure  Time  Less  Than  or  Equal  to  X 


Figure  A-13 

Reliability  and  Distribution  Functions 
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k.  The  reliability  function  i  •=  defined  as  the  probability  that 
an  item  will  survive  beyond  x  hours  mission  time. 

R(x)  =  P(X  •  x)  =  1  -  F(x) 


The  reliability  for  x  hours  mission  time  may  be  represented  as  the 
unshaded  area  in  figure  A- 12.  Using  the  normal  probability  density 
function  to  describe  the  data  in  figure  A-l,  the  reliability  function  is 
drawn  as  a  broken  line  in  figure  A-13.  To  illustrate,  R(30)  =  0.68. 


1.  The  other  function  to  be  defined  at  this  time  is  the  hazard 
function,  h(x),  sometimes  referred  to  as  instantaneous  iailure  rate. 

It  can  be  shown  that  the  hazard  function,  designated  as  h(x),  is 


h(x)  = 


f(x) 

R(x) 


failures  per  unit  time. 

A-9.  Probability  distributions,  a.  Knowledge  cf  the  distribution  of 
failure  times  for  a  population  of  items  provides  a  basis  for  reliability 
analysis.  The  preceding  graphical  illustrations  pertained  primarily 
to  a  particular  group  of  failure  time  data.  At  this  time,  certain  typical 
probability  density  functions  and  the  rel;  ted  reliability  functions  will 
be  summarized  with  appropriate  mathematical  notation. 

b.  Probability  density  functions  describe  the  variability  and 
behavior  of  random  variables.  Each  random  variable  has  its  own 
probability  distribution.  A  random  variable  may  be  defined  as  a  rule 
for  assigning  a  numerical  value  to  the  outcome  of  a  random  experiment. 
Some  examples  of  random  variables  are  height  of  an  individual,  sum  of 
the  upturned  faces  resulting  from  the  toss  of  two  dice,  the  number 
of  aces  in  a  poker  hand,  the  time  to  failure  of  a  piece  of  equipment,  etc. 
The  data  in  figure  A-l  represents  100  observations  of  failure  time,  a 
continuous  random  variable, 

(1)  Consider  the  continuous  random  variable  X  which  has 
a  probability  density  function  f(x).  The  density  function  has  the  properties 
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that 


f(x)  >  0 


and 


r 


f(x)dx  =  1 


(2)  The  density  function  serves  as  a  model  for  probth.lity 
statements  about  the  random  variable;  e.g., 


I  B 


and 


P(A<.  X  '  B)  =  '  f(x)dx 
A 


P(x  <  X  <  x  +  dx)  =  f(x)dx 


where 


dx 


0 


(3)  The  central  tendency  of  X  may  be  measured  by  the 
mean  or  expected  value,  E(X),  of  the  random  variable. 


COO 

xf(x)dx 


(4)  The  variance,  V(X),  of  the  random  variable  measures 
its  variability  and  is  defined  as 

V(X)  =  E(X^)  -  !  E(X)  ]2 

■_  J 


c.  The  distribution  function,  F(x),  which  in  reliability  analysis 
is  often  referred  to  as  unreliability  for  x  hours  mission  time  is 

C  x 

F(x)  =  P(X  <r  x)  =  '  f(t)dt 
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and  has  these  properties: 

(li  F(x)  >  0 

(2)  F{x)  is  a  non-decreasing  function 

(3)  F(- ™  )  =  0 

(4)  F{»)  =  i 

d.  For  a  random  variable,  X,  which  represents  failure  times, 
the  reliability  function  becomes 


rCD 

f(t)dt. 

.  x 

e.  The  hazard  function,  h(x),  sometimes  referred  to  as  in¬ 
stantaneous  failure  rate,  of  a  probability  distribution  of  times  to  failure 
is  often  used  in  reliability  considerations.  It  is  defined  as  the  conditional 
probability  density  function  of  time  to  failure,  given  the  item  has  not 
failed  prior  to  time  x.  In  other  words, 

h{x)dx  =  P  [  (x  "  X  '  x  +  dx)  |  {X  >  x)] 


which  reduces  to 


h(x)  = 


f(x) 

R(x) 


f.  Figure  A-l  1  provides  a  summary  of  the  above  relationships 
tor  continuous  random  variables. 
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Density  Function: 

i'(x) 

Distribution  Function: 

F(x)  =  \  f(t)dt 

'■-oo 

Reliability  Function: 

R(x)  =  1  -  F(x)  =  {  f(t)dt 

c-  X 

Hazard  Function: 

h(*)«  f<x! 

R(x) 

Expected  Value: 

E(X)  =  ^  xf(x)dx 

^  -03 

Variance: 

V(X)  *  E{X2)  -  t  E(X)  ]2 

F igure  A-  1  4 

Summary  of  Reliability  Related  Functions 

A-10.  Binomial  distribution,  a.  The  binomial  distri!  ution  provides 
a  model  often  useful  in  probability  computations.  It  differs  from  the 
previously  discussed  distributions  in  that  it  operates  on  a  discrete 
scale. 


b.  In  reliability  analysis,  we  are  frequently  interested  in 
the  total  number  of  failures  in  a  sequence  of  n  Bernoulli  trials.  Ber¬ 
noulli  trials  are  defined  as  repeated  independent  trials  of  an  experiment 
if  there  are  only  two  possible  outcomes  of  each  trial,  classified  as 
success  or  failure,  and  the  probability  of  failure  remains  constant 

for  each  and  every  trial.  For  purposes  of  reliability  analysis,  subjection 
of  n  identical  items  to  identical  use  conditions  may  be  identified  as  n 
Bernoulli  trials. 

c.  Let  the  random  variable,  K,  be  the  number  of  failu.es  in 
n  trials.  Then  the  probability  density  function,  or  P(K=k),  is 
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d.  For  the  binomial  distribution,  the  probability  distribution 
function  is  defined  as  the  probability  of  k  or  fewer  failures  in  n  identical 
(Bernoulli)  trials,  i,  e.  , 


k  /  n  \ 

F  (k)  =  P(K  k)  =  7  ' 

i  =  0  ,  i  / 

A  typical  binomial  distribution  model  ie  shown  in  figure  A- 16  for  param¬ 
eters  n  =  8,  j>  =  0.  7,  and  q  =  0,  3. 


Binomial  Probability  Distribution  Function,  F 

e.  To  exemplify  the  use  of  the  binomial  distribution,  consider 
a  particular  type  of  electrical  fuse  which  has  a  probability  of  0.  1  of 
failing  to  perform  properly  in  a  circuit.  If  five  such  fuses  are  subjected 
to  the  circuit,  what  is  the  probability  of  0  failures,  1  failure,  and  more 
than  1  failure  ? 
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n  =  5,  p  =  0.  1,  q  -  0.  9 

P(k)  =  /  l  ^  pkqn'k 

V  k  / 

P(0)  =  (  Q  )  (0.  1)°  (0.  9)5  =  0.  59049 
\  / 

P(l)  =  -r  5  N'1  (0.  I)1  (0.  9)4  =  5(0.  1)(0.  6561)  =  0.  32805 

\  1 

P(K  >  1)  =  1-0.59049-0.32805  =  0.08146 

f.  To  illustrate  a  typical  reliability  model  based  on  the  bi¬ 
nomial  distribution,  consider  a  regulator  on  an  oxygen  system  for  high 
altitude  flying  equipment  which  has  a  probability  of  0.  025  of  failing  to 
provide  the  required  oxygen  flow.  If  four  such  oxygen  systems  are  used 
on  a  mission  which  requires  that  at  least  three  must  function  properly, 
what  is  the  reliability  of  the  four  oxygen  systems  ? 

n  =  4 

p  =  0.025  -  probability  of  failure  by  an  oxygen  system 

q  =  0.975  =  probability  of  success  by  an  oxygen  system 

k  =  1  =  allowable  number  of  failures 

F (k=l )  =  P(K  <  1)  =  h  4  ^  (0.  025)1  (0.  975)4_i  =  0.997 
i=0  \  1  7 

g.  The  binomial  distribution  also  is  applicable  to  computations 
of  reliability  relative  to  one  shot  items.  For  example,  it  has  been  ob¬ 
served  that  a  bomb  fuze  has  a  probability  of  0.  2  of  failing  to  perform 
properly.  Consider  a  mission  involving  the  use  oi  seven  bombs  where 
the  mission  is  considered  successful  if  at  least  five  bombs  perform 
properly.  What  is  the  relicbility  of  such  a  mission? 
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n  =  7 

p  =  0.  2  =  probability  of  failure  by  any  one  bomb 
q  =  0.8  =  probability  of  success  by  any  one  bomb 
k  =  2  =  number  of  allowable  failures 

F(k=2)  =  P(K  2)  =  \  V'C.  2'1(0.  8)7"1  =  0.852 

i=0  v1  J 

A- 1 1 .  Normal  distribution,  a.  lhe  normal  distribution  is  sometimes 
useful  as  a  model  for  failure  times,  particularly  when  failures  are 
occurring  because  of  wearout.  A  normal  distribution  of  failure  times 
is  continuous  and  has  an  increasing  failure  rate.  This  model  is  often 
useful  when  mission  times  are  such  that  failures  are  due  to  wearout. 
Defined  below  are  the  normal  probability  density  function  and  related 
reliability  functions. 

b.  The  probability  density  function  for  the  normally  distributed 
random  variable  X  is 

f(x)  = - --1- . -  •  exp  I  -  -  (  ^  ] 

l  2  \  T  J 

where  -<*>  <  x  r  and  the  parame  ■  ~r  s  r  and  *  are  the  mean  and 

standard  deviation,  respectively.  ( <r  '■  is  referred  to  as  the  variance.) 
Figure  A- 17  shows  graphically  the  normal  probability  density  function 
with  parameters  =  1  and  =  0.  25. 

c.  Probability  tables  (table  H-2,  appendix  H)  are  available 

for  the  standard  normal  distribution.  Since  any  normal  random  variable 
X  can  be  transformed  to  the  standard  normal  random  variable  Z,  the 
tables  may  be  applied  to  any  normal  distribution. 
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Figure  A-17 

Normal  Probability  Density  Function,  f(x) 


(1)  The  transformation  is 


(2)  The  expected  value  and  variance  of  the  normal 
random  variable  X  is: 


E(X)  =  " 

V  (X)  = 

(3)  The  expected  value  and  variance  of  the  standard 
normal  variable  Z  is: 


E(Z)  =  0 
V(Z)  =  1 

d.  The  density  function  for  the  standard  normal  variable  is 

f(z)  =  -  --L —  exp 

JTT  V  2  / 
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where  -  <*>  <  z  ■-  ». 

e.  The  distribution  function  of  X  may  be  expressed  as  a 
function  of  Z. 

(  x  i  r  i  / 1  .  .A2I 

F(x)  =  P(X  <  x)  =  \  - - -  exp  -  i  -L_-— dt 

-no  T  *J  2T  .  2  \ 


\  "  ' 


exp 


/  -t2 
\  2 


where 


F(z)  values  can  be  obtained  from  table  H-2,  appendix  H. 

f.  The  reliability  function  of  the  normal  random  variable  X  is 

|  /x  _  „  M 

R(x)  =  1  -F{x)  =  P(X  >  x)  =  P  :  Z  >  - - -  =  z.  1 

\  .. 


=  l-F(z) 


The  normal  reliability  function  is  illustrated  in  figure  A- 18  for  param¬ 
eters  /  =  1  and  =  0,  25 


g.  The  hazard  function  for  the  normal  distribution  of  failure 
times  may  be  found  by 


h(x)  = 


f(x) 

R(x) 


A-30 


AMCP  702-3 


Normal  Distribution  Reliability  Function,  R(x) 


where 


f  (x )  =  lizi 

(T 

and  £(z)  may  be  found  from  table  H-9,  appendix  H.  Figure  A-19  con¬ 
tains  a  plot  of  the  normal  hazard  function  for  parameters  =  1, 

■  7  =  0.  25. 


h.  To  illustrate  the  use  of  the  normal  probability  density 
function  as  a  reliability  model,  consider  a  model  555  rifle  which  has 
demonstrated  a  normal  distribution  of  failure  times  with  ■  =  100  hours 

and  =  10  hours.  Find  the  reliability  of  such  a  rifle  for  a  mission 
time  of  104  hours  and  the  hazard  rate  of  one  of  these  rifles  at  age  105 
hours. 

R(x)  =  P  Z  >  -  '■  -  ' 

\ 

R(104)  =  P  /  Z  >  ^  =  P(Z  -  0.40)  =  0.34  as  found  in  table  H-2. 

\.  1C 


A-31 


AMCP  702-3 


Figure  A-19 

Normal  Distribution  Hazard  Function,  h(x) 


h(x)  »  l<*i 


f(x)  =  IhL 
c 

{ (x  =  105)  =  0.  10  f  X  z  =  ^~1C0  ^  =  c.  1(;  f(z  =  0 
V  10 

0.  10(0.  35)  0.  035 

where  f(z  =  0.5)  was  found  from  table  H-9. 

R(105)  =  P  X  2  >  12U£?.  ^  =  P(Z  >  0.  50)  =  0.  31 

1 0 

h(l05)  =  =  0.11  failures  per  hour 
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i.  The  example  which  follows  pertains  to  an  electronic  item. 
Failure  times  of  a  Type  GL,N  microwave  tube  have  been  observed  to 
follow  a  normal  distribution  with  ■  =  5000  hours  and  =  1500  hours. 

Find  the  reliability  of  such  a  tube  for  a  mission  time  of  4100  hours 
and  the  hazard  rate  of  one  of  these  tubes  at  age  4400  hours. 


A- 12.  Lognormal  Distribution,  a.  Another  model  which  is  sometimes 
useful  as  a  failure  model  is  the  lognormal  distribution.  It  is  summarized 
at  this  time  because  of  its  relationship  to  the  normal  distribution.  Consider 
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the  random  variable  X  as  failure  time.  If  In  X  is  a  normally  distributed 
random  variable,  X  is  said  to  be  distributed  in  accordance  with  a  log¬ 
normal  distribution.  A  summary  of  this  distribution  follows. 


b.  The  density  function  is 


f(x)  = 


exp 


r 


1  ^  In  x  -  i'  \ 2 

2  x 


x  >  0 


f(x)  =  0,  x  0. 

Figure  A-20  shows  this  density  function  for  r  =  2  and  T  =0.5.  The 
expectations  are 

E(X)  =  exp  {  t  +  I  t2  ^ 

\  ^  J 

V(X)  =  ^  exp  ^  2' 

\ 

where 

-  =  E(lnX) 

=  V(lr.  X) 

c.  The  distribution  function  is 


f  .^llexp  ^2Vl 


F{x)  =  P(X  <  x)  =  P  Z  <  ln  *  - 


d.  The  reliability  function  is 

R{x)  =  P(X  >  x)  =  P  (  Z  >  ln  *.Z.  ^ 

as  shown  in  figure  A-21  for  ;>  =  2  and  r  =  0.  5. 
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R (200)  =  P  '  Z  >  ln  z0°-6-  8  "\ 
\  1 


=  P(Z  >  -  1. 50)  =  0.  95 

h(x)  =  {J^L  =  LLzL- 

R(x)  -xR(x) 


h(200)  =  =  0.  0006475  ^  0>  00070  failures  per  hour. 

R(200)  0.93 

g.  The  following  example  relates  the  lognormal  reliability 
model  to  a  mission  length  expressed  in  units  other  than  time.  Suppose 
it  has  been  observed  that  gun  tube  tailures  occur  according  to  lognormal 
distribution  due  to  metal  fatigue  with  parameters  <  =7.0  and  <r  =  2.0. 
Find  the  reliability  for  a  1000-round  mission  and  the  hazard  rate  at 
800  rounds. 

R(x)  =  p''  Z>  ln. x  ~  !'.N; 

\  r 

R(1000)  =  P  ^  Z  >  ln  1 000-7.  0  N' 

\  2.0 

=  P(Z  >  -0.  045)=  0.  52 

h(x) 


h(800) 


- ,t,  .. _  =  0.  0004  failures  per  round. 

2 (800)(0.  5636 ) 


=  f(x) 


R(x) 


f  (800) 
R  (800) 


( 


z  = 


-  6.68-7 


) 


f  6.68-7  \ 
2(800)  P[  Z>  - 2 -  ) 
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A- 13.  Poisson  distribution,  a.  A  brief  investigation  of  the  Poisson 
process  will  provide  an  intuitive  basis  for  evaluating  the  usefulness  of 
tne  Poisson  distribution  as  a  reliability  model. 

b.  Considei  a  probabilistic  (stochastic)  process  which  is  subject 
to  the  occurrence  of  events,  all  of  which  are  of  the  same  kind,  and  we 
are  interested  in  the  number  of  events  that  occur.  Each  event  occurrence 
may  be  represented  as  a  point  on  a  time  6cale.  For  purposes  of  reli¬ 
ability  analysis,  an  even*  will  be  defined  as  a  failure.  Such  a  process 
having  the  following  characteristics  i9  called  a  Poisson  process. 

(1)  The  probability  that  a  given  number  of  failures  is  con¬ 
tained  in  a  time  interval  dependr  only  on  the  length  oi  the  interval, 

(and  not  on  where  the  interval  is  located  or  on  the  past  history  of  the  sys¬ 
tem). 


(2)  If  P(h)  is  the  probability  of  2  or  more  failures  in  an 
interval  of  length  h,  then 

lim  P(h)  _  Q 

h~«*  0  h 

Essentially,  this  imolies  that  failures  do  not  occur  simultaneously. 

(3)  Xi  Pj(h)  is  the  probability  of  1  failure  in  an  interval 
of  length  h,  then 

lim  Pi(h)  ^ 

h-*»0  ~ h  '  ' 


Essentially,  this  implies  that  failure  rate  does  not  depend  on  item  age; 
i.  e.  failure  rate  is  constant. 

c.  If  these  properties  are  satisfied,  the  Poisson  probability 
density  function  may  be  used  as  a  model  for  the  number  of  failures  in 
a  time  interval  of  length,  x.  If  the  random  variable  K  is  the  number 
of  failures  in  a  time  interval  of  length  x,  the  Poisson  density  function 
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d.  The  probability  distribution  function  is  defined  herein  as 

F  (k)  m  P(K  '  k)  =  0  ^  eX? — — 

i=0  i! 

which  is  graphed  in  figure  A-24  for  parameter  >.  x  =  4.  This  function 
may  be  graphically  evaluated  using  figure  H-12,  appendix  H. 


e.  To  exemplify  use  of  the  Poisson  distribution,  consider  the 
following  example.  A  Minuteman  launch  console  averages  0,001  lamp 
failures  per  hour.  What  is  the  reliability  for  a  500-hour  mission  if  no 
more  than  2  failures  can  be  tolerated? 
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k  =  2  failures 
x  =  500  hours 

=  0.001  failures  per  hour 
.x  x  -  0.  50 

F(k  =  2)  =  P{K  2)  =  I  !£: .3° I*. °;5°  =  0.  986 
_  i=0  i ! 

f.  A  second  Poisson  example  considers  failure  of  a  mechanical 
item.  During  the  first  year  of  operation,  a  1 /4-ton  truck  experiences 
failures  in  the  drive  train  due  to  defects  and  workmanship.  Failures 
occur  in  accordance  with  a  Poisson  process  with  a  mean  time  between 
failures  of  400  hours.  What  is  the  reliability  of  such  a  truck  if  no  failures 
are  allowed  for  a  mission  of  40  hours? 

x  =  40 

k  =  0 

X  =  1/400  =  0.0025  failures  per  hour 

P(K=k)  =  x ^ . 

k ! 

F(k=0)  =  P(K=0)  =  [  (0-  0025)(40)f  exp  [  (-0.  0025)(40)1 
=  exp  (-0.  10)  =  0.  90 

g.  The  following  example  illustrates  a  use  for  the  Poisson 
distribution  when  x  is  not  a  time  interval.  The  number  of  rocket-bomb 
hits  within  a  specified  small  portion  of  a  comparatively  large  area 
under  prolonged  bombardment  has  been  observed  to  follow  a  Poisson 
distribution.  The  rocket-bombs  average  0.  02  target  misses  per  bomb. 
What  is  the  reliability  of  a  50-shot  bombardment  if  no  more  than  2 
misses  are  allowed? 
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k  =  2  failures 
x  =  50  rounds 

,\  =  0,  02  failures  per  round 
>  x  =  1. 00 

F (k=2)  =  P(K  2)  =  h  .(t-  QQ)1  exP  00  =  0.  920 

"1=0  i! 

A-14,  Exponential  distribution,  a.  The  exponential  distribution  is  a 
popular  model  for  failure  times.  Some  particular  applications  of  this 
model  include: 

(1)  Items  whose  failure  rate  does  not  change  with  age. 

(2)  Complex  items  which  do  not  include  excessive  redundancy 
of  components  and/or  subsystems. 

(3)  Items  for  which  early  failures  have  been  eliminated, 
e.  g.  ,  vacuum  tubes  which  have  survived  a  burn-in  period. 

b.  The  exponential  density  function  may  be  obtained  directly 
from  the  Poisson  density  function.  Consider  the  continuous  random 
variable  X  as  the  time  to  failure  (or  time  between  failures).  Then 

f{x)  -  X  exp  (-Ax),  x  >  0 

f (x )  =  0,  x<  0 

c.  The  resulting  distribution  is  called  an  exponential  distribution. 
It  describes  the  random  variable  denoting  the  time  to  first  occurrence 

in  a  Poisson  process.  Since  the  Poisson  process  is  temporally  homo¬ 
geneous,  the  time  between  successive  occurrences  (failures)  has  the 
same  distribution.  Figure  A-25  portrays  graphically  the  exponential 
distribution  where  the  x  -cale  is  expressed  in  multiples  of  the  mean  time 
to  failure  (0).  The  expected  value  and  variance  of  X  are: 

/•« 

E(X)  =  \  x?  exp  (-;  x  dx  =  i  =  G 
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where  6  is  mean  time  to  failure  and  may  he  used  in  lieu  of  i  in  these 
expressions. 


V(X)  =  E(X2)  -  [  E(X)12  ^i^2^  e2 


Exponential  Probability  Density  Function,  f(x) 

d.  The  reliability  function  for  exponential  failure  times  becomes 

R(x)  =  exp  (-  >  x ) 

and  is  expressed  graphically  in  figure  A-26. 

e.  The  distribution  function  is 


F(x)  =  1  -  exp  (-  X  x) 
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Figure  A-26 

Exponential  Reliability  Function,  R(x) 
f.  The  hazard  rate  of  the  exponential  is 


h(x)  =  £<*L  =  A  exjg_(-Ax)  =  x 
R(x)  exp  (- A  x) 


which  indicates  the  distribution  applies  only  when  the  failure  rate  re¬ 
mains  constant  with  age.  This  is  expressed  graphically  by  figure  A-27. 

g.  To  illustrate  the  use  of  the  exponential  distribution,  consider 
a  computer  which  has  a  constant  error  rate  of  1  error  every  17  days  of 
continuous  operation.  What  is  the  reliability  associated  with  the  com¬ 
puter  to  correctly  solve  a  problem  that  requires  5  hours  time;  25  hours 
time?  In  addition,  find  the  hazard  rate  after  5  hours  of  use. 
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h(5)  =  0.0024  failures  per  hour 

h.  A  second  example  of  the  exponential  distribution  as  a  re¬ 
liability  model  considers  a  hydraulic  assembly  on  a  LAU-1967  aircraft 
which  has  exhibited  an  exponential  distribution  of  failure  times  with  a 
mean  time  to  failure  of  800  hours.  Find  the  reliability  of  this  assembly 
for  a  mission  time  of  50  hours  and  the  hazard  rate  at  an  age  of  100  hours. 

0  =  800  hours 

X  =  — - —  =  0.  00125  failures  per  hour 
800  * 

/  x  \ 

R(x)  =  exp  (-Ax)  =  exp  ; 

R{50)  =  exp  (  (-0.  00125)(50)  ]  =  exp  (-0.  0625 )  =  0.  94 

h{x)  =  1— -■  x-l-  =  A  =  0.00125  failures  per  hour 

for  all  X,  R«  “P  (->■*) 

A-15.  Weibull  distribution,  a.  The  exponential  distribution  is  applicable 
as  a  model  for  failure  times  only  if  the  failure  rate  is  constant  over  time. 

In  reality,  failure  rates  which  change  with  time  are  sometimes  encountered. 
The  normal  distribution  is  a  realistic  model  only  if  an  increasing  failure 
rate  is  encountered.  The  Weibull  distribution  is  continuous  and  can 
account  for  a  decreasing  failure  rate,  an  increasing  failure  rate,  or  a 
constant  failure  rate;  but  the  failure  rate  must  be  monotone. 

b.  The  Weibull  density  function  for  the  random  variable  X  is: 


f(x)  =  0,  x<  0 
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where 


%  r:  >  0 

3  =  shape  parameter 

^  =  scale  parameter 

Figure  A-28  shows  Weibull  density  functions  for  various  values  of 
■I  and  -  =  1 . 


f(x) 


Figure  A-28 

Weibull  Density  Function,  f(x) 

c.  The  expected  value  and  variance  of  the  Weibull  distribution  is 


E(X)=  r. 


/i.  0 
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Figure  A-29 

Weibull  Reliability  Function,  R(x) 
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f.  The  hazard  function  is 


mx).  asL.2  ''i'l 

R(x)  "  \ 


Weibull  hazard  functions  are  portrayed  by  figure  A-30  for  various 
values  and  for  r  =  1 . 


Tim*  (x) 


Figure  A-30 

Weibull  Hazard  Function 


g.  To  illustrate,  consider  the  failure  times  of  JP29M  trans¬ 
mitting  tubes  which  are  Weibull  distributed  with  ^  =  2  and  r  -  10CC 
hours.  Find  the  reliability  of  one  of  these  tubes  for  a  mission  time  of 
100  hours  and  the  hazard  rate  associated  with  one  that  has  operated 
successfully  for  100  hours. 
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A- 16.  Gamma  distribution,  a.  Another  continuous  distribution  which 
is  sometimes  useful  as  a  failure  model  is  the  Gamma  distribution. 

This  distribution  is  a  two-parameter  distribution.  Consider  the  ran¬ 
dom  variable  X  which  is  distributed  in  accordance  with  a  Gamma  dis¬ 
tribution.  A  summary  of  this  distribution  follows. 

b.  The  density  function  is 

a  o-l  ..  ,  , 

£(X)  =  _ e*£ - zhjSl,  x  >  0 

'  a 


wh  ere 


f(x)  =  0,  x  0 

a  >  h 

\  >  t 

a  is  a  shape  parameter 
•x  is  a  scale  parameter 


•  ■  i0\  _  \  x  a"  *  exp  (-x)  dx  and  can  be  evaluated  from  table 

JO 

H-  10,  appendix  H.  The  Gamma  density  function  is  displayed  for  various 
o  values  and  >.  =  1  in  figure  A -31. 

c.  The  expected  value  is 

E(X)  =  j 


and  the  variance  is 


V(X)  =  TZ  ■ 
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Figure  A-31 

The  Gamma  Density  Function,  f(x) 


d.  The  distribution  function  is 


F(x)  =  P(X  <•  x) 


cx 

o 


\a  t  1  exp  (  -  \t) 
t~  '  a  i 


dt 


Special  tables,  Table  of  Incomplete  Gamma  Function, 
are  required  to  evaluate  F(x).  However,  if  a  is  an  integer 


F(x)  =  1  ^  :>0k  exp  (-\x) 

k=  a  k! 


which  may  be  evaluated  from  a  Poisson  table. 


e.  The  reliability  function  is 
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If  a  is  an  integer 

R(x)  =  “V  (\  x)k  exp  (-  A  x) 
k=0  k! 

The  Gamma  reliability  function  is  displayed  for  various  values  of  » 
and  -  1  in  figure  A- 3 2. 


Figure  A-32 

The  Gamma  Reliability  Function 


f.  The  hazard  function  is 


h{x)  = 


f(x) 

R(x) 


is  displayed  for  various  a  values  and  X  =  1  in  figure  A-33. 

g.  In  addition  to  its  potential  use  as  a  failure  distribution,  the 
Gamma  distribution  serves  as  a  model  for  the  time  to  the  a  failure 
if  the  underlying  failure  distribution  is  exponential.  For  this  purpose, 
the.  random  variable  X  is  the  time  to  the  failure  and  a  can  assume 
only  positive  integer  values. 
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h(x) 


h.  The  following  example  illustrates  the  use  of  the  Gamma 
distribution  as  a  reliability  model.  A  Nark  missile  system  has  demon¬ 
strated  a  failure  distribution  which  fits  a  gamma  distribution  with  a 
and  A  =  0.05.  Determine  the  reliability  for  a  24  hour  mission  time 
and  the  hazard  rate  at  time  24  hours. 


R  (x)  =  1 


F(x)  =  1 


00 

r 

k  = 


(\x)k 


exp  (-  \  x) 
k! 


R(24)  =  1 


k=3 


(1. 2)k  exp  (-1.2) 
k! 


1  -  S  <•  3Q1>  <*■  2>k 
k-3  k! 


0.  88 


from  Poisson  curves,  figure  H-12,  appendix  H. 
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h{24)  =  =  nf"  =  0.012  failures  per  hour. 

Section  IV.  STRESS-STRENGTH  ANALYSIS 

A-17.  Introduction,  a.  In  previous  reliability  discussions ,  reli¬ 
ability  has  been  defined  as  a  function  of  mission  length.  Failure 
of  certain  materiel  items  such  as  one-shot  items,  mechanical  items, 
etc.  is  not  necessarily  dependent  upon  time  of  usage.  In  some  cases, 
failures  may  be  more  directly  traceable  to  some  other  stress  variable. 
Then  reliability  of  an  item  may  be  determined  by  comparing  its  strength 
to  the  stress  to  which  it  will  be  subjected.  Reliability  may  be  defined 
as  the  probability  that  strength  exceeds  stress. 

b.  Neither  item  strength  nor  the  stress  to  which  it  is  sub¬ 
jected  are  constant  values,  but  both  are  random  variables  each  with 
its  own  probability  density  function.  If  these  distributions  are  known, 
reliability  may  be  determined  analytically.  Since  data  is  generally 
limited  to  sample  information,  the  goodness -of  fit  methods  of  appendix 
F  may  be  used  in  an  attempt  to  identify  the  appropriate  underlying 
distributions. 

A-18.  Normal  stress  and  strength  distributions,  a.  Assuming  both 
the  stress  and  strength  distributions  to  be  normal,  reliability  can  be 
determined  as  follows: 
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(1)  Item  strength  (S)  is  a  random  variable  with  normal 
probability  density  function 


f(S)  - 


rS 


-T"  exp  - 


1  ^s-,,s  \2 1 

2  v  TS  /  j 


where 


r  c  =  mean  strength 

r  g  =  strength  standard  deviation 

(2)  Stress  (s)  is  a  random  variable  with  normal  probability 
density  function 


f(s) 


exp 


1  ( 

2 


s  -  v 


where 


lis  =  mean  stress  level 

jb  =  stress  standard  deviation 

(3)  Then  the  difference  D  =  S-s  is  a  random  variable 
with  normal  probability  density  function 


f(D)  =  - ™=T - -  exp 

T  D  ^ 


i fD  ~  a d 

2  ^  ~D 
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where 


D  *  "  S  '  ;  e 


=  mean  difference 


p  =  v  rs  +  rs  =  stan^arc*  deviation  of  difference 


(4)  Then  reliability  may  be  defined  as 


/  0  -  ;;  r\  v 

R  -  P(D  >  0)  =  P  Z  > - —  )  = 


P  '  Z  >  '  D 

V  rD 


which  may  be  determined  from  table  H-2,  appendix  H. 

b.  To  exemplify,  the  material  strength  (ultimate  shear  stress) 
of  a  lug  shear  is  a  normally  distributed  random  variable  with  a  mean 
of  104,  300  psi  and  a  standard  deviation  of  3,  600  psi.  The  stress  to 
which  the  lug  is  subjected  is  a  normally  distributed  random  variable 
with  a  mean  of  95,  160  psi  and  a  standard  deviation  of  2,  070  pBi.  What 
is  the  reliability  of  the  lug  in  such  an  environment? 


■  •  =  95, 160  psi 

r  „  -  2, 070  psi 


c  g  =  104,  300  psi 
’  g  =  3,  600  psi 


S  *  ‘  s 


=  9,  140  psi 


T  D  =  a  TJ  +  rl  =  4-i53  P8i 


-91.40—  =  2.  20 

4153 


in  table  H-2. 


R  =  P(Z  >  -  2.  20)  =  1  -  P(Z  >  2.  20)  =  0.  986  as  found 
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A-19.  Getieral  stress  -  strength  distributions.  a.  Determination 
of  reliability  based  on  stress -strength  analysis  requires  that  both 
the  stress  and  strength  probability  density  functions  [f(s)  and  f(S) 
respectively]  be  known.  As  shown  above,  analytic  determination  is 
quite  straightforward  if  both  distributions  are  normal.  Although 
analytic  determination  is  difficult  for  other  distributions,  reliability 
can  be  determined  from 


f(S)dS  1  ds 

which  lends  itself  to  numerical  methods  easily  adapted  for  uBe  by 
digital  computers. 

b.  Graphical  determination.  The  following  technique,  using 
transformations,  provides  a  graphical  reliability  determination  which 
may  be  applied  to  any  distribution.  It  may  also  be  applied  to  sample 
data  when  the  underlying  distribution  cannot  be  identified.  The  follow-, 
ing  elements  are  involved. 

i  00 

(1)  Let  G  =  '  f(S)dS 

s 

c* 

(2)  Let  H  =  '  f(s)ds  which  implies 

0 

dH  =  f(s)ds 
/  1 

(3)  Then  R  =  '  G  d  H  which  may  be  evaluated  by  plotting 

0 

G  as  a  function  of  H  and  finding  the  area  between  the  function  and  G  =  0 
and  between  H  =  0  and  H  =  1.  Figure  A- 34  indicates  this  graphically 
for  a  hypothetical  function. 

c.  Example  -  Known  mathematical  distribution.  (1)  The 
above  procedure  may  be  applied  to  density  functions  either  in  mathe¬ 
matical  or  empirical  form.  The  example  which  immediately  follows 


.  (*' 


f(s)  ! 
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Hypothetical  Plot  of  G  as  a  Function  of  H 

applies  the  technique  to  the  situation  where  both  distributions  are 
known  in  mathematical  form.  The  bursting  strength  of  a  given  class 
of  rocket  motors  is  known  to  be  exponentially  distributed  with  mean 
strength  of  20.  000  psi,  i.  e.  ,  the  strength  density  function  is 


,/c.  .1  f  -S 

20, 000  eXP  v  20. 000 


The  pressure  exerted  by  a  given  propellant  charge  is  distributed  Weibull 
with  parameters  ^  =  2  and  n  =  18,  000  psi,  i,  e.  ,  the  stress  density 
function  is 


f(s)  = 


/ 


13,000  v  18,000. 


\  1 

/  s  yi 

■  J  exp  | 

v 18, 000  ) 

Find  the  reliability  of  this  class  of  rocket  motors  when  propelled  by 
the  above  type  charge. 


Define 


C.f;f(S>dSM-F(S».)=exp(.^) 


I 
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and 

H  =  (  8  f(s)ds  -  F(s)  =  1  -  exp  !  -  f  - 2 - Y  ’ 

0  \  18, 000  j 

Figure  A-35  is  a  table  of  (H,  G)  coordinates  calculated  from  several 
different  stress  values.  These  coordinates  are  to  be  plotted  to  deter¬ 
mine  the  reliability  graphically. 


s 

H 

G 

0 

0 

1 

5, 000 

0.  07 

0.  78 

7,  COO 

0.  14 

o 

-J 

o 

10, 000 

0.  27 

0.  61 

12, 000 

0.  36 

0.  55 

15, 000 

0.  50 

0.47 

18, 000 

0.  63 

0.  41 

20, 000 

0.  71 

0.  37 

25, 000 

0.85 

0.  29 

27, 000 

0.  91 

0.  26 

c 

1 

0 

Figure  A-35 

Calculated  (H,  G)  Coordinates 

(2)  Figure  A-36  is  a  plot  of  these  (H,  G)  coordinates  and 
the  resultant  reliability  is  represented  by  the  shaded  area  and  is  numeri 
cally  equal  to  0.49.  (This  was  obtained  by  measuring  the  shaded  area. ) 

d.  Example  -  Empirically  determined  distributions.  (1)  This 
example  iB  the  same  as  the  preceding  example  except  that  f(s)  and  f(S) 
are  not  known  and  reliability  must  be  estimated  using  observed  sample 
data  for  both  stress  and  strength.  Bursting  strengths  (psi)  for  a  sample 
of  ten  rocket  motors  have  been  observed.  These  values  listed  in  as 
cending  order,  are  shown  in  figure  A-37.  Also  shown  areF(S)  values 
which  represent  an  estimate  of  the  unknown  distribution  function  F(S) 


Figure  A-36 

Plot  of  (H,  G)  Coordinates 
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bursting  strength  corresponding  to  each  observed  strength  value. 
($(S)  is  the  relative  frequency  of  sample  values  which  are  less  than 
or  equal  to  S. ) 


/N 

s 

F(S) 

14, 100 

0.  10 

15,  200 

0.  20 

16, 300 

C  30 

16,  600 

0.  40 

17, 700 

0.  50 

17  700 

0.  60 

lfe. 800 

0.  70 

19, 000 

0.80 

20, 800 

0.  90 

25, 100 

1.  00 

Figure  A- 37 

Observed  Bursting  Strengths  (psi) 

(2)  Figure  A-38  shows  a  plot  of  these  coordinates  and  a 
smooth  curve  is  drawn  to  fit  che  trend  of  the  points.  This  curve,  ^(S), 
is  used  as  an  estimator  of  the  F(S)  function. 

(3)  The  exerted  pressures  (psi)  observed  from  a  sample 
of  twenty  propellant  charges  of  a  given  type  are  shown,  in  ascending 
order,  by  figure  A-39.  Also  shown  are  estimates,  ^(s),  of  F(s)  for 
each  observed  stress  value. 

(4)  Figure  A-40  shows  a  plot  of  these  coordinates  ard  a 
curve  drawn  through  the  trend  of  the  points.  This  curve,  F(s),  is 
an  estimate  of  the  F(s)  function. 
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(5)  Using  the  estimated  stress  and  strength  distribution 
functions,  (H,  G)  coordinates  have  been  found  for  assorted  stress 
values  and  listed  in  figure  A-41.  The  values  were  found  as  follows: 

H  =  F(s) 

A 

G  =  1  -F(S  =  s) 


$ 

A  ^ 

F(s) 

9,  200 

0.05 

10,  100 

0.  1C 

10,  800 

0.  15 

11,  800 

0.  20 

I?, 100 

0.  25 

12,  200 

0.  30 

12, 300 

0.  35 

14,  100 

0.  40 

14, 800 

0.  45 

15,  000 

0.  50 

15,  400 

0.  55 

16,  20 0 

0.  60 

16,  800 

0.  65 

17,  200 

0.  70 

17,  200 

0.  75 

17,  800 

0.  80 

18, 300 

0.  85 

18, 500 

0.  90 

18, 700 

0.  95 

19,  100 

1.  00 

Figure  A-39 
Observed  Stresses  (psi) 

(6)  Figure  A-42  is  a  plot  of  these  (H,  G)  coordinates  and 
the  resultant  reliability  is  represented  by  the  shaded  area  and  is  nu¬ 
merically  equal  to  0.71.  (This  was  obtained  by  measuring  the  shaded 
area.  ) 
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s 

H 

G 

0 

0 

1. 00 

5,  000 

0.  01 

0.99 

10, 000 

1.  10 

0.  97 

15, 000 

0.  49 

0.  82 

16, 000 

0.  59 

0.  71 

17, 000 

0.  71 

0.  58 

18, 000 

0.  83 

0.  41 

19, 000 

0.  94 

0.  25 

20, 000 

0.  99 

0.  03 

** 

1. 00 

0 

Figure  A  42 

Calculated  (H,G)  Coordinates 


Section  V.  CONCEPT  OF  SYSTEM  EFFECTIVENESS 

A-20.  System  effectiveness  evaluation,  a.  General.  The  concept 
of  system  effectiveness  was  defined  in  chapter  1  as  the  function  of 

three  groups  of  variables - i.  e.  ,  those  pertaining  to  availability, 

dependability  and  capability.  The  example  which  follows  is  hypo¬ 
thetical  and  is  a  gross  oversimplification,  but  it  is  intended  to  em¬ 
phasize  the  reliability  considerations  associated  with  the  concept 
of  system  effectiveness. 

b.  Problem  statement.  The  system  to  be  considered  is 
that  comprised  of  the  XXX  helicopter  and  its  communication  equip¬ 
ment.  It  is  to  operate  in  a  limited  warfare  environment  where 
rapid  movement  of  supplies  upon  request  is  important.  The  mission 
of  the  system  is  that  of  transporting,  upon  random  call,  supplies 
from  a  central  supply  base  to  troop  activities  within,  a  radius  of  1/2 
hour  flying  time.  Once  the  helicopter  has  reached  the  target  area, 
proper  functioning  of  the  communication  equipment  enhances  the 
chances  of  a  successful  delivery  of  the  supplies  in  terms  of  safe 
landing  area,  location  of  enemy  troops,  etc.  Some  major  assumptions 
which  are  inherent  in  this  example  are: 
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(1)  A  call  for  supplies  is  directed  to  a  single  helicopter 
which  is  located  at  the  base.  If  this  craft  is  not  in  flyable  condition 
(i.  e<  ,  it  is  in  process  of  maintenance)  the  mission  will  not  be  started. 

A  flyable  craft  is  defined  as  one  which  is  in  condition  to  take  off  and 
fly  with  a  standard  supply  load. 

(2)  The  flight  time  required  to  reach  the  target  area  is 

1/2  hour. 

(3)  The  communication  equipment  cannot  be  maintained 
or  repaired  in  flight. 

(4)  A  loaded  helicopter  which  goes  down  while  on  route 

to  or  does  not  reach  the  target  area  has  no  delivery  value,  i.  e.  ,  assume 
that  supplies  lost  in  route  cannot  be  effectively  recovered  by  ground 
troops . 


c.  Model  determination.  (1)  For  purposes  of  model  formula¬ 
tion,  the  system  condition  is  divided  into  3  states,  namely: 

(a)  State  1  -  Helicopter  flyable,  communication 
equipment  operable. 

(b)  State  2  -  Helicopter  flyable,  communication 
equipment  non-operable. 

(c)  State  3  -  Helicopter  non-flyable. 

(2)  The  effectiveness  model  is  defined  as 

E  -  ADC 

where  A,  D  and  C  are  defined  as  follows: 

(a)  The  availability  vector  is  a  three  element  row 

vector,  i.  e. 


A  -  (a  j ,  a^ ,  a^) 
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where  is  the  probability  that  the  helicopter  will  be  in  state  i  at 
the  time  of  call. 


(b)  The  dependability  matrix  is  a  3  x  3  square  matrix, 


where  d-.  is  the  probability  that,  if  the  helicopter  is  in  state  i  at  the 
time  cf  call,  it  will  complete  the  mission  in  state  j. 


(c)  The  capability  vector  is  a  three  element  column 

vector  i.  e.  , 


where  c^  is  the  probability  that,  if  the  helicopter  is  in  state  i  at  the 
time  of  arrival  at  the  target  area,  the  supplies  can  be  successfully 
delivered.  (For  multicapability  items,  C  would  be  a  multicolumn  matrix.  S 


d.  Determination  of  model  elements.  (1)  Past  records 
indicate  that  the  average  time  between  maintenance  activities  (in¬ 
cluding  preventive  and  failure  initiated  maintenance)  for  this  type 
helicopter  is  100  hours  and  the  average  duration  (including  such  vari¬ 
ables  as  maintenance  difficulty',  parts  availability,  manpower,  etc.  ) 
of  a  maintenance  activity  is  10  hours.  Comparable  data  for  the 
communication  equipment  shov/s  an  average  time  between  mainte¬ 
nance  activities  of  500  hours  and  an  average  duration  of  a  mainte¬ 
nance  activity  of  5  hours. 


(2)  From  the  preceding  data  the  elements  of  A  can  be 

determined. 
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a^  =  P(helicopter  flyable)P(communication  equipment 

operable) 


/  100  >  /  500  \ 

\  100+10  '  \ 500+5  . 


0.  900 


a£  =  P(helicopter  flyable)P(communication  equipment 

not  operable) 


f  100  \f  5  \ 

v  100+10  '  \500+  5  J 


0.  009 


ai  =  P(helicopter  not  flyable)  =  —r— —  =  0.  091 
J  r  7  100+10 


(3)  Data  available  from  past  records  indicate  that  the 
time  between  failures  of  the  communication  equipment  during  flight 
are  exponentially  distributed  with  a  mean  of  500  hours.  Also  the  prob¬ 
ability  that  a  helicopter  in  flight  will  not  survive  the  1/2  hour  flight  to 
its  destination  is  .  05  (includes  probability  of  being  shot  down,  mechan¬ 
ical  failures,  etc.  ).  Then  the  elements  of  the  D  matrix  may  be  calcu¬ 
lated  as  follows: 


(a)  If  the  syst  <  begins  in  state  1: 

djj^  =  P(helicopter  will  survive  flight)P(communication 
equipment  will  i  “main  operable) 

=  (1  -0.  05)  I  exp  ■  -  ^  1=  0.  94905 

d|2  =  P(helicopter  will  survive  flight)P(communication 
equipment  will  fail  during  flight) 

=  (1  -.  05)  1  1  -  exp  /  -  ^  |  =  0.00095 

\  500 

djj  =  P(helicopter  wiil  not  survive  the  flight)  =  0.  05000 
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(b)  If  the  system  begins  in  state  2: 

d2i  =  0  because  the  communication  equipment  cannot 
be  repaired  in  flight. 

^22  =  P(helicopter  will  survive  the  flight)  =  0.  95000 

d£j  ■=  P(helicopter  will  not  survive  the  flight) 

=  0.05000 

(c)  If  the  system  begins  in  state  3: 

d-jj  =  d^2  -  0  because  the  mission  will  not  start. 

d33  =  1,  i.  e.  ,  if  the  helicopter  isn't  flyable,  it  will 
remain  non-flyable  with  reference  to  a  par¬ 
ticular  mission. 


(4)  Experience  and  technical  judgment  have  determined 
the  probability  of  successful  delivery  of  supplies  to  be  if  the  system 
is  in  state  i  at  the  time  of  arrival  in  the  target  area,  where 

Cj  =  0.  95 

C£  =  0. 80 

C3  =  0 

e.  Determination  of  effectiveness.  (1)  The  effectiveness 
of  the  subject  system  becomes 


E  =  (0.  900  0.  009  0.  091) 


0.94905  0.00095  0.05000 
0  0.95000  0.05000 

0  0  1 


=  0.  82  =  (0.  900)  (0. 94905)  (0.  95)  + [ {0. 900)  (0. 00095)  + 

(0.  009)(0.  95000) ](0.  80)  +  [(0.  900)(0.  05)  + 

(0.009)  (0.05)  +  (.091)  (1)]  (0) 

which  means  that  the  system  has  a  probability  of  0.  82  of  successful 
delivery  of  supplies  upon  random  request. 
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(2)  The  effectiveness  value  attained  provides  a  basis 
for  deciding  whether  improvement  is  needed.  The  model  provides 
the  basis  for  evaluating  the  effectiveness  of  alternative  systems  con¬ 
sidered. 

f.  The  preceding  example  was  not  intended  to  emphasize 
the  technical  approach  to  system  effectiveness  evaluation,  but  to 
point  out  that  reliability  is  a  factor  of  effectiveness  and  may  be  con¬ 
sidered  at  more  than  one  point  in  system  life.  For  example,  relia¬ 
bility  of  the  system  (and  subsystems)  must  be  considered  for  the  en¬ 
vironment  encountered  while  awaiting  mission  call  (such  as  storage, 
temporary  use,  etc.)  i.  e.  ,  for  determining  the  availability  elements. 
Reliability  also  comes  into  the  picture  during  the  mission,  i.  e.  ,  in 
determining  the  dependability  elements.  In  addition,  reliability  must 
be  considered  relative  to  each  of  the  system  states. 

Section  VI.  RELIABILITY  DESCRIPTORS 

A-21.  Some  meaningful  parameters.  Any  of  several  different  descrip¬ 
tors  may  be  used  for  measuring  or  specifying  the  reliability  of  a  pro¬ 
duct.  A  useful  descriptor  must  be  meaningful  in  terms  of  the  defini¬ 
tion  of  reliability.  Commonly  used  reliability  descriptors  include  :he 
probability  of  success  in  x  hours  mission  time,  mean  time  between 
failures  (MTBF),  hazard  function,  and  probability  of  success  where 
time  isn't  of  primary  importance.  Each  of  these  is  dependent  upon 
a  specified  intended  function  and  use  environment. 

a.  Probability'  of  success  for  x  hours  mission  time.  (1)  This 
descriptor  is  actually  the  basic  definition  of  reliability  and  is  meaning¬ 
ful  whether  or  not  the  underlying  failure  distribution  is  known.  It  is 
composed  of  a  probability  statement  as  well  as  the  mission  duration 
time  to  which  the  probability  applies.  It  represents  a  single  point  on 
the  reliability  function  curve  as  defined  earlier  in  this  appendix. 

(2)  This  descriptor  may  be  related  to  other  reliability 
indices  if  the  underlying  failure  distribution  is  known. 

b.  Mean  time  between  failures.  (1)  MTBF  is  a  very  popu¬ 
lar  measure  of  reliability.  However,  care  must  be  exercised  in  its 
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use  since  the  reliability  level  associated  with  MTBF  is  dependent  upon 
the  failure  distribution.  In  other  words,  MTBF  is  a  meaningful  measure 
of  reliability  only  if  the  failure  distribution  is  known. 

(2)  To  illustrate  the  different  reliability  levels  associated 
with  a  mission  time  equal  to  MTBF,  consider  the  exponential  and  normal 
failure  models. 

(a)  For  the  exponential  failure  distribution, 

R(MTBF)  =  exp  f  -  MT3F  ^  »  0.  37 
\  MTBF  / 

(b)  For  the  normal  failure  distribution, 

R(MTBF)  =  P(Z  >  0)  =  0.  50 

c.  Hazard  function.  (1)  The  hazard  function  is  sometimes  used 
as  a  measure  of  reliability.  Its  use  requires  both  an  instantaneous  fail¬ 
ure  rate  and  the  equipment  age  at  which  this  failure  rate  is  in  effect.  The 
hazard  function  can  be  related  to  reliability  level  only  if  the  underlying 
failure  distribution  is  known. 

(2)  The  special  case  of  exponential  failures  reduces  the 
hazard  function  to  a  constant  failure  rate  which  is  independent  of  equip¬ 
ment  age. 

d.  Probability  of  success.  For  items  whose  failure  is  not  de¬ 
pendent  on  time,  reliability  may  be  expressed  as  the  probability  of 
success  under  specified  stress  conditions.  This  descriptor  is  especial¬ 
ly  useful  when  considering  one-shot  items. 
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APPENDIX  B 

RELIABILITY  PROGRAM  REQUIREMENTS 
PLANNING  AND  MANAGEMENT  GUIDE 

Section  I.  INTRODUCTION 

B-l.  General.  This  appendix  is  designed  to  supplement  chapter  2. 

It  provides  guidance  information  for  planning  and  management  of  a 
reliability  program.  This  guidance  takes  two  forms  :  first,  a 
discussion  of  some  fundamentals  of  network  diagramming  and  second, 
a  general  network  to  use  as  an  example  when  developing  a  plan  for 
reliabil.ty  management  of  a  specific  project. 

Section  IL  FUNDAMENTALS  OF  NETWORK  DIAGRAMMING 

B-2.  General.  Several  forms  of  tins  technique  exist,  the  details  vary 
somewhat,  although  the  underlying  principles  are  the  same.  The 
technique  is  assigned  to  assist  program  managers  in  planning  and  con¬ 
trolling  a  variety  of  interrelated  projects.  None  of  the  techniques  are 
discussed  n  detail  herein.  It  is  the  purpose  of  this  appendix  to  show 
the  sequence  of  events  and  identify  the  interfaces,  relationships,  and 
constraints  of  a  reliability  program  by  means  of  an  activity  diagram. 
The  reader  must  remember  that  networks  such  as  this  are  not  devices 
for  measuring  the  reliability  of  a  product. 

B - 3 .  Definitions  of  terms  used  in  network  diagramming. 

a.  Network. 

(1)  A  network  is  a  flow  diagram  consisting  uf  the  activities 
and  events  which  must  be  accomplished  to  reach  the  project  objectives 
(total  life  cycle)  showing  the  planned  sequences  of  accomplishment, 
interdependencies  ana  interrelationships.  It  is  used  as  a  tool  in  the 
project  management  decision  making  process  for  planning  activities  to 
be  performed,  as  w'ell  as  progress  reporting  and  corrective  action. 
The  network  includes  all  action  involved  and  is  not  limited  to  work 
activities.  Time  consuming  actions,  such  as  lead  time  for  procure¬ 
ment  of  purchased  parts,  shipment  of  materiel  from  one  location  to 
another,  and  management  action,  are  shown  on  the  network. 
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(2)  The  network  serves  as  the  basis  for  scheduling  work. 

The  sequence  of  activities  and  their  relationships,  elapsed  time 
estimates,  and  directed  completion  dates  of  key  milestones  are  basic 
information  for  establishing  wor..  schedules. 

(3)  The  network  can  also  identify  problem  areas  which 
require  management  emphasis.  Critical  activities  which  could  delay 
the  accomplishment  of  the  project  objectives  are  highlighted  so  that 
management  attention  is  continously  focused  on  such  activities.  A 
program  change  or  anticipated  schedule  slippage  of  one  activity  can 
quickly  be  analyzed  to  show  the  effect  on  other  activities  and  the 
entire  project. 

(4)  The  network,  in  addition,  serves  as  a  communication 
device  for  all  levels  of  management.  It  is  a  common  language  which 
operating  and  management  personnel  can  interpret  easily  and 
accurately. 

b.  Event. 

(1)  An  event  is  a  specific  definable  accomplishment  in  a 
program  plan,  recognizable  at  a  particular  instant  in  time.  Events 
do  not  consume  resources  nor  take  time  to  complete.  They  simply 
reflect  a  state  of  being,  i.e.,  something  is  developed,  tested, 
started,  completed,  etc.  Words  which  express  a  state  of  being 
should  be  used  to  describe  an  event. 

(2)  Events  may  represent  points  of  decision,  the  accomplish¬ 
ment  or  beginning  of  a  significant  phase  of  rhe  total  job,  ;he  transfer 
of  responsibility  from  one  organization  to  another,  or  the  r  -mpletion 
or  start  of  one  or  more  activities.  Thus,  events  by  themselves 
cannot  always  specify  all  of  the  activities  which  are  connected  to 
them. 


(3)  The  usual  procedure  for  representing  events  is  to  use 
circles  or  boxes,  although  a  number  of  various  shaped  enclosures 
can  be  "sed  to  represent  different  types  of  events.  An  example  of 
two  events  is  shown  in  figure  B-l. 


@ — 


Figure  B-l.  Event-Activity  Relationship 
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<4)  Events  numbered  10  and  22  are  related  and  unless  event  10 
is  completed,  the  activity  between  them  cannot  be  started.  Furthermore, 
it  will  be  impossible  to  reach  the  point  in  time  represented  by  event  22 
until  the  activity  represented  by  the  arrow  is  completed. 

c.  Activity. 

(1)  An  activity  is  the  work  effort  of  a  program.  It  is  that  which 
must  be  done,  characterized  by  people  using  facilities,  materials,  and 
equipment  over  some  period  of  time  to  accomplish  a  stated  objective. 
Activities  imply  doing  such  things  as  researching,  building,  negotiating, 
testing,  etc.  Activities  are  the  flow  of  a  network,  and  it  is  this  flow  of 
human  effort,  materials,  use  of  facilities,  investment,  and  expense 
that  can  be  controlled  by  the  manager. 

(2)  In  order  to  avoid  confusion  in  the  milestone  list,  and  gen¬ 
erally  to  improve  the  clarity  of  presentation,  considerable  attention 
should  be  given  to  the  names  of  events  and  activities.  Since  an  activity 
implies  doing  or  acting,  it  should  be  expressed  as  a  verb  form  (develop, 
test)  which  will  not  be  confused  with  the  beginning  or  completion  point 
of  the  activity.  Each  description  of  an  event  or  an  activity  should  be 
concise  so  that  personnel  with  different  backgrounds  and  points  of  view 
will  interpret  it  in  the  same  manner. 

(3)  An  activity  is  represented  on  a  network  by  an  arrow  with 
the  head  of  the  arrow  pointing  in  the  direction  of  the  time  flow  as 
shown  in  figure  B-l.  The  activity  connecting  the  two  events  cannot 
begin  until  event  number  10  is  completed  nor  can  event  number  22  take 
place  unless  the  activity  is  completed.  When  several  activities  lead 
to  an  event,  all  activities  must  be  completed  before  the  event  comes 
into  existence.  For  instance,  the  network  activities  numbered  7-10, 

0-10,  and  6-10  in  figure  B-2  must  all  be  completed  before  event 
number  10  can  occur. 


B-3 


Figure  B-2  Network  Schematic 


(4)  A  simple  example  of  the  proceding  schematic  diagram 
illustrated  in  figure  B-3. 


Figure  B-3  Network  Diagram 
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d.  Dummy  activities. 

(1)  A  dummy  activity  or  z  ro  time  activity  is  one  which 
neither  consumes  resources  nor  takes  time  to  complete.  The 
dummy  activity  is  useful  because  it  constrains  the  beginning  of  a 
following  activity,  or  the  completion  of  the  event  to  which  it  leads 
by  requiring  that  the  event  from  which  it  proceeds  be  completed 
first.  It  is  often  used  to  tie  the  completion  of  several  activities 
to  the  beginning  of  a  single  activity,  or  vice  versa. 

(2)  The  restraint  may  also  be  used  in  cases  where  it  is  de¬ 
sired  to  indicate  by  separate  events  the  ending  of  one  activity  and  the 
beginning  of  the  following  one.  This  may  be  desirable  in  cases 
where  it  is  necessary  to  be  quite  sure  that  the  following  activity  begins 
immediately  as  planned.  Figure  B-4  shows  a  dummy  (zero  time) 
activity  (B-C)  between  two  events  to  indicate  the  completion  of  one 
activity  and  the  beginning  of  another  activity. 


© - ►© . ■*© - ►© 

Begin  Complete  Begin  Complete 

Fabrication  Fabrication  Test  Test 

Figure  B-4  Dummy  Activity 

B-4.  Network  organization,  a.  The  typical  weapon  (or  equipment) 
system  development  project  requires  a  hierarchy  of  networks  in  order 
to  meet  the  needs  of  different  levels  of  management.  Each  of  the 
various  networks  is  similar  in  concept,  but  differs  in  level  of  detail 
in  accordance  with  the  user's  responsibility.  Since  the  project  manager 
has  total  project  responsibility,  his  emphasis  would  be  upon  key 
milestones  and  gross  project  activities  portrayed  on  the  top  level 
network.  The  operating  engineer’s  network,  on  the  other  hand,  con¬ 
tains  checkpoints  related  to  his  particular  portion  of  the  total  task, 
interconnected  by  precisely  defined  activities.  A]  l  networks  in  the 
hierarchy  are  related  to  one  another  via  commo-"  e.ents,  whereby 
activity  time  estimates  from  the  detailed  networt  •  may  oe  summarized 
into  forecasted  achievement  dates  for  major  project  milestones. 
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b.  The  appropriate  organization  of  the  hierarchy  of  networks 
for  any  project  must  be  determined  by  the  project  manager  to  meet 
the  requirements  of  his  project.  Many  factors  influence  the  network 
organization,  such  as  the  size  and  complexity  of  the  project,  the  or¬ 
ganizational  structure  of  the  project  manager's  office  and  performing 
organizations,  and  the  computer  programs  when  applicable. 

Section  III.  RELIABILITY  NETWORK  DIAGRAM 
AND  MILESTONE  CHART 

B-5.  General  description,  a.  To  obtain  a  reliable  system,  a  reli- 
bility  management  program  must  be  a  continuing  process  throughout 
the  life  cycle  of  an  item.  This  section  contains  a  major  milestone 
network  identifying  those  events  generally  necessary  for  effective 
monitoring  of  the  reliability  program  throughout  a  system's  life  cycle. 

b.  The  network  is  not  all  inclusive  and  should  not  be  inter¬ 
preted  as  the  panacea  in  reliability  management.  It  is,  however,  con¬ 
sidered  an  excellent  guide  in  the  major  areas  of  reliability  management. 
Not  every  milestone  is  the  responsibility  of  a  reliability  manager,  but 
the  Interface  of  general  milestones  to  reliability  milestones  is  required 
to  grasp  the  overall  relationship  in  the  life  cycle. 

c.  Both  general  managers  and  reliability  managers  must  be 

aware  of  the  interrelationship  and  impact  each  has  on  the  other's  dis¬ 
cipline.  The  attainment  of  a  reliable  system  is  riot  the  responsibility 
of  any  one  organization  or  individual,  but  represents  an  integrated 
effort  of  all  management  throughout  the  item's  life  cycle. 

d.  The  network  in  this  appendix  is  divided  into  top  management 
and  top  work-level  milestones. 

(1)  Top  Management.  Those  responsible  for  decisions  and 
policies,  i.e.,  personnel  levels  1,  2  and  3  in  figure  B-5. 

(2)  Top  Work  Level.  Those  responsible  for  implementing 
policies  and  securing  necessary  reliability  data,  i.e.,  levels  4  and  5  in 
figure  B-5. 
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e.  A  sample  personnel  chart  (figure  B-5)  is  included  to 
generally  relate  the  milestones  to  a  particular  command  and  action 
level.  The  acceptance  and  assignment  of  responsibilities  should 
filter  from  the  top  level  downward. 

f.  The  milestone  definitions  included  are  event  oriented. 

The  explanation  is  a  brief  description  of  activities  leading  into  or 
from  the  event.  Thus,  it  is  possible  for  each  manager  to  expand  the 
events  within  his  functional  area  of  responsibility  to  cover  alL  aspects 
of  reliability.  Top  management  milestones  are  identified  by  Roman 
numerals;  top  work-level  milestones  by  Arabic  numerals,  with  AMC 
interface  milestones  from  AMCR  11-27  shown  parenthetically  follow¬ 
ing  the  milestone  title. 

g.  The  milestone  chart  is  divided  into  the  concept  and  defini¬ 
tion  phases  (figure  B-6) ,  the  development  phase  (figure  B-7) ,  and  the 
production,  operation  and  disposal  phases  (figure  B-8) . 

B-6.  Definitions  of  management  milestones  for  reliability. 

a.  Concept  Phase  (see  figure  B-6). 

I.  Guidance  Documents  Initiated.  The  Army  planning  documents 
BASE,  ASP,  AFDP ,  et  al,  which  s'  .  guidelines,  objectives,  and  pri¬ 
ority  operational  requirements,  are  initiated.  These  documents  fore¬ 
cast  the  needs  and  technological  advances,  thereby  formii  g  the  frame¬ 
work  for  the  Army's  total  mission  responsibility.  They  also  initiate 
the  materiel  life  cycle  and  provide  guidance  during  the  concept,  defini¬ 
tion,  and  development  phases.  The  above  documents  are  reviewed 

and  updated  annually. 

II.  User  Requirements  Established.  Studies,  which  culminate  in  new 
or  improved  doctrine,  organizatl onal  concepts,  operational  capability 
objectives,  logistical  concepts,  QMDO’s,  and  QMR's,  are  completed. 

These  studies  establish  user  requirements  for  new  items  and  materiel 

to  satisfy  future  tactical  concepts.  A  desirable,  but  realistic,  reli¬ 
ability  goal  is  established  as  a  result  of  these  studies.  Activities 
are  planned  and  conducted  within  the  framework  provided  by  the  guidance 
documents . 
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III.  Technological  Forecasting  Completed.  All  basic  research 
projects,  such  as  parametric  analysis,  applied  research,  techno¬ 
logical  forecast,  system  synthesis,  technical  estimates,  etc.,  are 
completed.  These  analytical  studies  provide  data  and  a  theoretical 
basis  for  predicting  the  expected  scientific  and  technical  gains  to  be 
achieved  by  the  anticipated  production  date.  By  determining  what 
and  where  fundamental  knowledge  is  lacking,  development  efforts 
arc  precluded  from  less  productive  areas  until  additional  research 
work  is  accomplished.  The  predictions,  capabilities,  objectives, 
concepts,  and  estimates  resulting  from  these  projects  provide  in¬ 
formation  for  QMDO  requirements,  such  as  the  proposed  reliability 
goal. 

IV.  QMDO  Approved  and  Assigned  <0  100).  A  Qualitative  Materiel 
Development  Objective  (QMDO)  is  an  Army-approved  statement  of 
military  need  for  the  development  of  new  materiel,  the  feasibility  or 
specific  definition  of  which  cannot  be  determined  sufficiently  to  per¬ 
mit  the  establishment  of  a  Qualitative  Materiel  Requirement  (QMR). 
Approval  of  the  QMDO  provides  the  first  formal  requirements  docu¬ 
ment  that  the  Army  uses  in  the  research  and  development  cycle. 

This  document  should  contain  a  proposed  reliability  goal  for  the  item 
under  consideration.  The  QMDO  is  assigned  by  AMC  to  one  of  the 
subordinate  commands  or  laboratories  on  a  sole,  prime,  or  attendant 
basis.  The  designated  development  agency  will  prepare  and  coordinate, 
with  other  developing  agencies  that  have  competence  and  responsibili¬ 
ties  in  the  area  concerned,  a  brief  but  specific  plan  that  outlines  all 
the  research  and  development  work  that  is  required  to  prove  out  the 
feasibility  of  the  QMDO.  The  plan  summarizes  existing  research 
projects  and  tasks,  slates  an  estimate  of  the  additional  projects  and 
tasks  required  to  achieve  the  technological  capability,  and  gives  an 
estimate  of  the  research  risks  involved  in  each  approach.  Cost 
estimates  arc  also  included. 

1.  Total  Feasibility  Study  Completed  (0000).  The  total  feasibility 
study,  which  includes  consideration  of  technical  feasibility,  cost 
effectiveness,  system  effectiveness,  availability  of  all  funds  through¬ 
out  th'1  life  cycle,  qualitative  and  quantitative  personnel  implications, 
operational  and  organizational  concepts,  logistical  support  implica¬ 
tions,  and  impact  upon  inventory,  is  completed.  This  study  stales 
determinations  that  the  Department  of  Army  is  capable  of  supporting 
the  desired  new  item  of  materiel  throughout  i's  life  cycle.  Completed 
when  AMC  technical  data  to  support  the  item  or  system  is  submitted  to 
Department  of  Army. 
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2.  QMA  Established.  The  Qualitative  Materiel  Approach  (QMA) , 
based  on  review  of  research  feasibility  and  standard  equipment  capa¬ 
bility  for  the  expected  state  of  the  art,  is  established.  The  QMA 
describes  recommended  technical  approach(es)  or  solution(s)  to  a 
materiel  requirement.  It  will  include:  trade-offs  in  approaches,  time 
to  develop,  size  and  weight,  cost  cf  operation  (manpower  and  funds), 
technological  risks,  estimated  development  and  procurement  costs, 

and  comparison  with  existing  items,  if  applicable. 

V.  TDP  Initiated.  The  preliminary  Technical  Development  Plan  (TDP) 
is  used  for  programming  purposes  In  order  to  obtain  program  approval 

on  a  timely  basis.  Information  included  in  the  preliminary  plan  should 
include  initial  concepts,  schedules,  and  funding  estimates.  In  addition, 
the  plan  i9  eypected  to  outline  those  plans  for  development  and  provide 
guidance,  goals,  and  specific  direction  necessary  to  assure  that  opera¬ 
tional  effectiveness  will  be  achieved.  The  inclusion  of  statements 
delineating  performance,  reliability,  and  maintainability  are  aimed  at 
this  goal.  This  document  is  to  be  prepared  by  the  responsible  Army 
developing  agency. 

VI.  QMR  Initiated.  The  initial  draft  proposed  Qualitative  Materiel 
Requirement  (QMR)  document  is  initiated.  Contents  of  the  QMR  are 
based  upon  national  defense  objective,  intelligence  estimates,  and 
concept  or  feasibility  studies  which  determine  the  requirements  for  a 
new  capability  and  the  need  for  a  new  item.  The-  QMJR  expresses  De¬ 
partment  of  Army  requirerae.nts  for  new  equipment  or  for  major  in¬ 
novations  or  improvements  related  to  research  and  development  as 
developed  from  new  concepts.  During  preparation  of  the  QMR,  the 

CDC  will  coordinate  with  AMC  to  assure  that  proposed  requirements 
reflect  current  state  oi  the  art  and  best  integration  of  competitive 
characteristics.  This  milestone  taks  place  when  AMC  begins  prepara¬ 
tion  of  the  technical  data  to  complete  the  QMR  or  SDR. 

VII.  Reliability  Documentation  Initiated.  Documentation  of  the  reli¬ 
ability  requirements  to  be  placed  in  the  QMR  and  TDP  is  initiated. 

3.  QMR  Reliability  Requirements  Established.  Documentation  of 

the  basic  reliability  requirements  to  be  placed  on  the  item  is  completed. 
This  is  a  clear  and  concise  set  of  statements  which  includes  the  object 
or  mission,  the  quantitative  reliability  require:  ents— essential  and 
desired--and  the  definition  of  what  constitutes  a  failure. 
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VIII.  Draft  Proposed  QMU  Submitted  (0400).  The  draft  proposed 
QMR,  consisting  of  information  required  in  milestones  V[[,  VIII  and  3, 
is  reviewed  and  submitted  to  CDC. 

4,  I  DP  Reliability  Requirements  Established.  A  summation  of 
reliability  requirements  covering  system  and  subsystem  characteris¬ 
tics,  performance  requirements,  and  the  reliability  review  point 
schedule  are  established  for  the  preliminary  TDP  document, 

IX.  TDP  Reliability  Documentation  Completed.  Tntogration  of  relia¬ 
bility  requirements  (milestone  4)  and  other  information  pertinent  to 
the  preliminary  IDF  (milestone  VI)  is  completed. 

X.  Preliminary  TDP  Approved.  The  preliminary  TDP  containing 
reliability  document  at  ion  is  reviewed  and  approved. 

b.  Definition  Phase  (see  figure  13-6). 

XT .  RFP  Initiated.  1  he  Request  for  proposal  (RFP)  documentation 
is  initiated  by  the  consumer  complete  with  the  system  mission  and 
requests  for  contractor  schedules  and  methods  for  development.  The 
information  to  be  included  must  consist  of  both  technical  and  managerial 
aspects  of  the  proposed  engineering  development,  it  should  be  informa¬ 
tion  that  will  be  meaningful  to  the  potential  contractors  in  preparing 
their  respective  proposals. 

3.  Prediction  Requirement  Established.  The  requi  roment  for 
contractor  prediction  of  item  reliability  is  established  and  documented 
in  the  RT'P.  'This  requirement  should  include  consideration  of  quanti¬ 
tative  predictions  and  a  schedule  for  updating  predictions. 

o.  Apportionment  Requirement  Established.  The  requirement 
for  contractor  apportionment  of  item  reliability  is  established  and  docu¬ 
mented  into  the  Ui-'P.  The  requirement  shall  be  clearly  stated  so  as  to 
assure  achievement  of  item  reliability.  Any  previous  experiences  with 
these  systems  shall  be  referenced  in  the  RFP. 
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7  .  Record  Keeping  Requirement  F.scabl  ished  ■  The  requirement 
for  contractor  record  keeping  of  iteir.  reliability  data  is  established 
and  documented  in  the  RFP.  This  requirement  should  call  for  an 
effective  record  keeping  system  which  specifies  the  type  of  informa¬ 
tion  to  be  recorded,  such  as  reliability  tesL  :  •  ilts,  technical  prob¬ 
lems,  and  progress  reports  on  item  reliabil  i  t’>.  t  should  also  require 
a  schedule  for  status  reporting. 

8.  Testing  Requirement  Established.  The  requirement  for  the 
contractor  to  adequately  demonstrate  achievement  of  item  reliability 
is  established  and  documented  in  the  RFP.  This  will  include  any 
definite  tests  required,  methods  of  testing,  conditions  for  testing, 
test  schedule,  use  of  test  results,  and  other  test  requirements  when¬ 
ever  applicable. 

9.  Trade-off  Policy  Requirement  Established.  The  requirement 

for  contractor  establishment  of  a  trade-off  policy,  covering  the  inter¬ 
relationships  of  cost,  support  performance,  and  safety  as  related  to 
reliability,  is  documented  into  the  RFP. 

XII.  RDP  Approved.  The  RDP  is  reviewed  for  compliance  with 
original  reliability  requirements.  After  compliance  has  been  verified 
and  approved,  the  RDP  is  used  as  a  communication  link  between  the 
Army  and  prospective  contractors. 

XIII.  Contract  Definition  Contracts  Awarded.  The  findings  and  recom¬ 
mendations  resulting  from  evaluation  of  the  initial  proposals  have  been 
provided  by  the  appropriate  agency  to  Department  of  Army  for  contract 
award  to  potential  development  contractors. 

XIV.  Proposals  Received  and  Review  Initiated.  As  the  contractor's 
proposals  are  received,  they  are  thoroughly  reviewed  for  compliance 
with  reliability  requirements  as  requested  in  the  RDP. 

XV.  Organization  Review  Completed.  Reviews  of  the  prospective 
contractors'  managerial  acticities,  including  organization  structures, 
training  programs,  and  personnel  technical  capabilities.  Results  of 
this  review  should  indicate  whether  or  not  the  prospective  contractor 
gives  proper  emphasis  to  reliability. 
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XVI.  Testing  Program  Review  Competed.  The  testing  programs 
proposed  by  the  interested  contractors  to  demonstrate  reliability  are 
reviewed.  These  reviews  encompass  test  environments,  equipment, 
data  feedback  programs,  analysis  techniques,  and  use  of  test  results 
to  answer  that  the  RFP  requirements  are  included  and  understood. 

XVI I .  Detailed  Reliability  Review  Initiated.  After  all  the  proposals 
have  been  submitted,  a  comprehensive  review  of  reliability  provisions 
is  initiated.  The  results  of  this  review  should  plan  an  important  role 
in  deciding  upon  the  prospective  development  contractor.  The  purpose 
of  this  review  is  to  evaluate  proposals  for  apportionment,  prediciton, 
and  trade-off  policy  with  respect  to  feasibility,  completeness,  and 
clarity . 

10.  Block  Diagram  Review  Completed.  The  reliability  block 
diagram  for  the  overall  system  Is  reviewed  to  assure  all  aspects  of 
the  system  have  been  given  proper  consideration.  This  includes  such 
things  as  determining  if  the  diagram  is  sufficiently  descriptive  of  the 
proposed  system  from  both  an  operational  and  technical  viewpoint. 

This  diagram  is  the  basis  for  a  reliability  apportionment  model. 

11.  Standard  Subsystems  Review  Completed.  Proposed  sub¬ 
systems  utilizing  standardized  parts  and  assemblies  are  evaluated 
for  acceptability  of  reliability  apportionment.  Also,  it  should  be 
assured  by  this  review  that  standard  subsystems  have  been  employed 
when  applicable  in  order  to  minimize  cost. 

12.  Developmental  Subsystem  Review  Completed.  Proposed 
subsystems  requiring  development  of  new  items  are  reviewed  with 
regard  to  reliability  apportionment.  This  review  covers  the  non¬ 
standard  subsystems  that  are  to  be  employed  in  the  various  proposals. 
The  proposals  should  provide  adequate  empirical  data  to  determine 
that  the  required  reliability  of  these  new  subsystems  can  be  achieved. 
Also,  math  models  should  be  provided  in  the  proposals  to  illustrate 
how  the  reliabilities  apportioned  to  the  subsystems  are  to  be  achieved. 

13.  Reliability  Design  Techniques  Evaluation  Completed.  The 
developmental  subsystems  are  reviewed  for  reliability  design  tech¬ 
niques.  This  includes  the  proper  use  of  partial  redudancy,  mixed 
models,  standby  redundancy,  etc.  The  review  should  concentrate  on 
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hotii  the  possible  use  ol  such  techniques  where  they  are  applicable 
but  not  considered  in  the  proposals,  and  the  use  of  such  techniques 
in  situations  where  their  use  is  not  warranted  because  ot  already 
acceptable  reliability,  nonfeasibility ,  excessive  costs,  etc. 

XV111,  Re liabi lity  Appo r tioninent  Evaluation  Completed.  Evaluation 
of  the  reliability  apportionment  section  of  the  proposal  is  completed. 
This  apportionment  represents  a  possible  means  of  achieving  ih>' 
required  system.  reliability.  It  should  be  ascertained  whether  or  not 
(he  apportionment  has  been  done  optimally;  i.e.,  to  minimize  cost 
while  maintaining  overall  system  reliability. 

14.  History  Check  Evaluation  Completed.  The  contractor's  use 
of  failure  data  concerning  standard  subsystems  utilized  in  the  pro¬ 
posals  is  checked  for  accuracy,  applicability,  and  cornpl.  teness. 

This  evaluation  should  verify  that  the  data  used  to  support  'he  use 

of  any  such  subsystem  was  obtained  from  conditions  similar  to  those 
which  the  subsystem  will  be  subjected  to  in  the  new  system.  This 
evaluation  establishes  the  validity  of  the  data  for  reliability  prediction 
purposes. 

15.  State  of  the  Art  Review  Completed.  Projections  for  the  state 
of  the  art  throughout  development  and  production  are  reviewed  and 
compared  to  the  projection  from  the  total  feasibility  study  conducted 
earlier  in  the  CDP.  The  purpose  of  such  a  review'  is  to  assure  that 
the  progress  for  development  of  such  equipment  is  consistent  with  the 
anticipated  schedule  established  earlier  in  the  CDP.  Any  differences 
should  be  noted  in  order  that  potential  problems  can  be  identified,  li 
is  important  that  such  problems  be  pointed  out  in  this  review  because 
they  may  cause  delay  in  project  completion  or  even  prove  the  project 
infeasible  for  completion. 

16.  Minimum  Reliability  Evaluation  Completed  The  minimum 
reliability  predictions  are  evaluated  to  assure  that  Ihe  system  require¬ 
ment  is  met.  If  the  system  requirement  is  not  met,  the  results  should 
point  out  possible  courses  of  action  to  correct  such  defic iencie s . 

17.  Optimum  Reliability  Evaluation  Completed.  Predictions  of 
desirable  reliability  are  evaluated  to  assure  that  the  predictions  are 
realistic.  Careful  attention  should  be  giver,  to  the  contractor  s  under¬ 
lying  assumptions  for  meeting  the  reliability  values  quoted.  Any 
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invalid  assumptions  or  unrealistic  reliability  values  should  be  railed 
to  his  alu  nl ion . 

XIX.  Reliability  Prediction  Aecopu-d.  Evaluation  of  the  reliability 
prediction  section  of  the  proposals,  as  a  suitable  outcome  lor  system 
reliability,  is  completed.  The  results  of  this  evaluation  are  to  be 
used  in  deciding  which  of  th<  prospective  contractors  will  receive  the 
c ont  fact . 

18.  Trade-Off  F’oiicy  Reliability  Evaluation  Completed.  A n y 
contractor  proposed  change  in  estimated  development  cost,  time, 
performance,  support,  safety,  human  engineering,  etc.,  made  at 
the  expense  of  reliability  will  be  carefully  evaluated  as  trade-off 
consiae  rat  ions . 

XX.  Trade-Off  Policy  Accepted.  After  the  trade-off  considerations 
are  analyzed,  the  selected  proposed  trade-off  policy  is  accepted. 

XX!.  Proposal  Selection  Completed.  The  most  probable  proposailsl 
to  succeed  in  development  and  to  meet  the  technical  requirements 
is(are)  selected.  Major  reliability  considerations,  which  the  contrac¬ 
tor  expresses  in  his  proposal,  should  be  given  proper  emphasis  in 
proposal  selection. 

XXII,  Coordinated  lest  Program  Approved  (1400b  The  Coordinated 
Test  Program  (CTP)  is  an  all-inclusive  materiei  test  plan  which 
specifies  test  objectives,  number  of  prototypes  to  be  available,  en¬ 
vironmental  testing  required,  testing  schedule,  funding  requirements, 
test  support  requirements,  and  whether  an  integrated,  concurrent,  or 
sequential  testing  program  will  be  conducted.  This  milestone  is  com¬ 
pleted  on  acceptance  of  the  test  program  by  major  commands,  project 
managers,  or  agencies  involved.  After  acceptance,  the  program  is 
included  in  the  TDP.  It  is  reviewed  and  updated  at  the  technical 
characteristics,  engineering  concept,  and  design  characteristics 
in-process  review. 

19.  QMR  Updated.  Based  on  review  and  evaluation  of  the  pro¬ 
posals,  the  QMR  may  need  to  be  revised  and  updated.  Changes 
affecting  reliability  will  be  worded  so  as  not  to  lose  the  intent  of  the 
reliability  requirement. 
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XXII.  QMR  Approved  (0700) .  The  updated  QMR  is  reviewed  with 
proper  emphasis  placed  on  reliability.  After  receiving  a  satisfactory 
review,  the  OMR  :.s  approved  by  Department  of  Army. 

XXIV.  Technical  Characteristic  IPR  Completed  (1500).  This  review 
is  held  upon  receipt  of  the  approved  QMR  and  prior  to  finalizing  the 
technical  characteristics.  The  primary  purpose  of  the  technical 
characteristics  in-process  review  (IPR)  is  to  insure  that  the  developer 
understands  the  requirement  and  has  properly  stated  it  in  terms  of 
technical  character istirs .  The  technical  characteristics ,  once  ap¬ 
proved  by  the  proper  authority,  are  used  for  full-scale  development, 
either  in-house  or  by  contract. 

20.  TDP  Revised.  A  re-evaluation  and  revision  of  the  TDP 
incorporating  inputs  from  the  CTP,  selected  prooosal(s)  ,  and  the 
technical  characteristic  IPR,  is  completed.  This  TDP  presents  in 
detail  an  illustrative  format  and  a  comprehensive  plan  for  develop¬ 
ment  of  a  system.  Factors  considered  on  a  continuing  basis  are  the 
management  plan,  configuration  management  plan,  test  and  evaluation 
plan,  personnel  and  personnel  training  plan,  logistics  support  plan, 
facilities,  foreign  technology,  planned  production,  and  technical 
documentation. 

XXV.  Updated  TDP  Approved  (0900).  The  updated  TDP  is  reviewed, 
with  proper  emphasis  being  placed  on  the  reliability  section,  and 
approved.  It  is  the  prime  basis  for  approval,  disapproval,  or  modi¬ 
fication  of  the  project.  It  describes  auu  is  the  approved  plan  for 
execution  by  the  Army.  The  TDP  is  to  be  updated  and  changed  as 
required  throughout  the  program. 

XXVI.  Development  Decision  Made.  A  decision  is  made  on  whether 

or  not  to  enter  the  development  phase.  The  decision  sh-uld  be  based 
on  the  results  of  effectiveness  studies,  as  well  as  whether  or  not  the 
proposals  show  that  the  reliability  requirements  can  be  met. 

c.  Development  Phase  (see  figure  B-7) 

XXVII.  Development  Contract  Awarded  (2000).  The  primary  contract 
is  executed  by  the  contractor  and  contracting  officer  for  development 
of  the  item. 
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XXVIII.  Reliability  Specialist  Assigned  lo  Ofvolopnn'ni  Program. 

When  an  agency  receives  developmental  responsibility  tor  an  item, 
an  mdividual(s)  knowledgeable  in  the  technical  aspects  of  reliability 
isfarel  assigned  the  responsibility  for  monitoring  for  reliability 
throughout  the  development  program.  This  is  to  provide  assurance 
to  the  Army  that  reliability  is  being  given  proper  emphasis  in  the 
development  activities. 

XXIX.  Predevelopment  Conference  Completed.  A  prcdevelopme.it 
conference  to  clarify  the  contractor's  responsibilities  for  meeting 
contractual  requirements,  including  those  relating  to  reliability,  is 
completed. 

XXX.  Start  Preliminary  Design  Review.  Review  during  preliminary 
design,  as  performed  by  the  contractor,  is  to  include  reliability  con¬ 
siderations,  Such  reviews  will  facili'ate  early  evaluation  and  identi¬ 
fication  of  potential  design  troubLe  areas. 

21.  Math  Model  Evaluation  Completed.  The  math  model,  includ¬ 
ing  the  block  diagram,  is  evaluated  for  total  consideration  and  adequacy. 
This  provides  assurance  that  all  functional  and  failure  modes  have  been 
properly  considered  and  that  the  model  provides  an  adequate  repre¬ 
sentation  of  the  relationship  between  item  reliability  and  the  reliability 
of  subsystems,  parts,  and  components. 

22.  Reliability  Prediction  Review  Completed.  Basic  contractor 
reliability  predictions,  which  support  preliminary  design,  are  re¬ 
viewed  to  assure  that  predictions,  including  any  revised  predictions, 
are  suitable  and  are  based  on  sound  rationale,  important  considera¬ 
tions  include  standard  parts,  derating,  functional  complexity,  re¬ 
dundancy,  and  failure  definition. 

23.  Reliability  Apportionment  Review  Completed.  The  reliability 
apportionment  of  the  preliminary  design  is  reviewed  against  the  pro¬ 
posed  values  of  the  definition  phase.  Major  deviations  should  be  in¬ 
vestigated.  Of  major  importance  is  the  compatibility  of  apportioned 
goals  with  the  cost  and  schedule  for  fulfilling  these  goals. 


B-  17 


.Mt- 1 :  'i'c-  i 


24 Potential  Problem  Action  Kva_lu;it  ion  Compl  cted  .  Eva  Inal  Ion 
uf  the  corrective  action  program  details  as  proposed  bv  the  contractor 
to  handle  potential  reliability  problems  is  completed.  The  program, 
should  provide  for  action  which  is  both  tirralv  and  teclinleally  adequate. 

23  ■  Review  and  Recommendat  ion  Completed.  The  preliminary 
development  design  is  reviewed  for  reliability  aspects  and  relevant 
trade-off  recommendations  are  presented  to  decision  makei  . 

XXXI ■  Engineering  Concept  ln-Process  KEview  Comple ted  (1700 ' 

The  contractor's  preliminary  design  is  reviewed  and  decisions  are 
reached  on  all  recommendations .  These  activities  may  become  a 
part,  of  the  engineering  concept  review  (ECR).  Rigid  attention  to  reli¬ 
ability  in  this  IPR  assures  that  the  design  concept  is  not  beyond  the 
state  of  the  art  and  that  all  feasible  engineering  approaches  have  been 
Considered . 

XXXII.  Inltate  Engineering  Design  Review.  Reliability  analysis  of 
the  system  as  development  proceeds  from  preliminary  design  into 
detailed  engineering  development  is  initiated.  Analyses  should  be 
continuously  updated  to  reflect  the  most  recent  information  available. 

26.  First  Hardware  Assessment  Completed.  The  reliability 
assessnient  of  experimental  and  standard  component  test  results  and 
of  the  contractor's  failure  mode  and  effects  analysis  (FMEA)  is  com¬ 
pleted.  Data  is  obtained  from  tests  conducted  by  the  contractor. 
A^tlyri;  rf  Lbccc  data  '-‘ill  provide  an  aa^csomcuC  of  leliabiiicy  growth 
and  may  provide  an  identification  of  additional  potential  problem  areas. 

27.  Corrective  Action  Verification  Completed.  Verification  that 
the  corrective  actions  which  have  been  taken  bv  the  contractor  will 
improve  reliability  and  are  in  accordance  with  established  trade-off 
policy . 

28.  GFE  Document  Completed.  A  document  stating  the  predicted 
reliability  and  potential  reliability  problems  of  proposed  government- 
furnished  equipment  (GFE)  is  completed.  This  report  will  be  based 

upon  prior  field  use  data  and,  when  necessary,  due  to  lack  of  sufficient 
data  on  the  capabilities  of  GFE,  tests  of  these  items  shall  be  per¬ 
formed.  When  the  apportioned  reliability  requirement  is  not  met,  a 
trade-off  recommendation  is  established  and  placed  In  the  document. 
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2'j,  Mat!’  Model  Review  C’utri^iitM-tal .  The  math  model  is  reviewed 
for  adequacy  based  on  the  latest  reliability  information.  Requests  for 
updating  are  made  as  appropriate.  An  updated  model  will  provide  an 
assessment  of  item  reliability,  reflecting  latest  test  information  and 
latest  block  diagram  changes  which  have  resulted  from  corrective 
act  tun . 

30  . _ Reliability  Prediction  Review  Completed .  Any  revised  pre- 

dictions  made  hv  the  contractor  are  reviewed  for  adequacy  and  rationale. 
The  predictions  should  reflect  the  updated  block  diagram  and  math  model. 

31.  Reliability  Apportionment  Review  Completed.  The  updated 
reliability  apportionment  is  reviewed  to  insure  that  all  changes  are 
acceptable  to  che  government  and  that  they  do  not  conflict  with  other 
performance  parameters.  The  revised  apportionment  goals  should 

be  compatible  with  economic  and  schedule  constraints. 

32.  Maintenance  Support  Plan  Irputs  Completed  (2200).  As  the 
initial  maintenance  support  plan  is  prepared,  reliability  personnel 
have  the  responsibility  of  supplying  data.  This  data  should  contain 
as  a  minimum;  failure  mode;  failure  rate;  50%  failure  life;  and  the 
failure  impact.  The  purpose  of  this  plan  is  to  assure  timely  avail¬ 
ability  of  all  elements  required  for  support  of  the  item  in  the  field. 


33.  Recommendations  for  Trade-Offs  Submitted.  The  contractor’s 
suggested  trade-offs  are  assessed  and  recommendations  are  submitted 
for  decision  at  the  design  characteristics  in-process  review. 


XXXIII.  Design  Cna recter istlcs  In-Process  Review  Completed  (2700). 
Results  of  the  engineering  design  are  reviewed  and  decisions  reached 
on  all  recommendations  to  avoid  development  of  ha"H*;are  that  does 
not  satisfy  the  requirement. 


XXX I V .  Detailed  Design  Review  Initiated.  Review  ot  all  detailed 
design  efforts  in  terms  of  reliability  is  initiated.  This  review  will 
normally  be  carried  down  to  part  level.  Major  effort  should  concen¬ 
trate  in  areas  such  as  unique  design  and  new  or  unproven  parts. 
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3  1 .  K  n g  ;  ;ie  c  r  i  n c.  Pc  :»upi  I’csl  i!i|;  l  i  u  1 1  ojc  i  cil  iZ'Utui.  Knginec  rnij; 
(li’.smn  a  i'  i  ■  a  *  >1  tests  i  dm  lui  Ivil  on  a  s  v  :• 1  i  1 1 1  or  i  i  c  i  i  .  b\ 

components  or  sub.i  ,wi  1  ib  1  ir  s  as  soon  as  i  lu  \  .m  l.iln  it  .Uoi  ana  >  1  <  ■  - 
live  red  by  lh"  ion :  r  ,u  1  o  r  .  Ihcsc  icsis  arc  conducted  by  ■ 1  r  under  the 
control  ol  the  design  agency  lor  ilcicrinintnu  inhc  ren!  m  liability,  The 
series  includes  slal  islie.il  In bn  rate  rv-coni  roiled  lesis  in  determine 
'he  eileels  ol  I  vine '  )  ■  ma  I  and  environmental  siresso  no  ibe  sid  >  s  v  s '  el  i  ■  s  . 
Tlii'  purpose  ol  such  lest  me  is  m  collect  design  da'a,  •  mliim  ptv- 
Pnnnarv  eoneepis  and  calculations.  and  dele  riivine  1 1 . « ■  *  oinpa1  i  lu  1 1 1  y 
ol’  components.  1  he  m  i  iviiy  preceding  'his  evi  :a  s  loiopleied  when 
the  developing  a  g  e  m  y  is  ready  In  release  ihe  1 1  r.  a  o  i  c  p .  •  ;  o  r  PI'S] 
testing  or  to  procure  KT/S1  models, 

3S.  Kng  ineering  Pi'Slgn  Tis'mg  ices  ill's  Analysis  (  .unplel  ed  . 

The  results  ol  the  engineering  design  tests  are  analysed  to  pinpoint 
areas  of  low  reliability,  llu  analysis  will  cover  mci  hamcal .  idee, 
trical,  and  chemical  properties,  as  well  as  the  lunclional  mlcrl.iies, 
of  the  subsystems.  (II  K  items  ..re  not  to  be  passed  over  durmt;  the 
analy  s  >  s . 

3<j.  Probable  I-ailurc  Modes  Review  Completed.  Probable 
failure  modes  of  the  system  are  updated  by  the  contractor  and  re¬ 
viewed  by  the  government  tor  critical  modes  anti  frequency  of  failure. 

37.  Proposed  Corrective  Actions  Review  (uimpleled.  The  con¬ 
tractor's  suggested  corrective  actions  are  reviewed  lo  determine  the 
effects  on  reliability  and  tradn-off  policy. 

38.  Final  Daia  Chi  ck  Completed.  The  final  data  check  is  com¬ 
pleted.  This  involve  a  ih.t  i  .vievc  and  evaluation  ot  the  final  updated 
math  model,  system  apportionment,  and  reliability  prediction  based 
on  test  re  suits. 

3'i.  Initiate  Trade-off  Study,  initiate  trade-off  study  based  on 
results  of  detailed  design  efforts. 

40.  Formulation  of  Trade-Off  Recommendations  Completed .  To 
preclude  potential  problems,  trade-off  recommendations  are  formu¬ 
lated  in  consonance  with  trade-off  policy  established  during  the  defini¬ 
tion  phase  anil  submitted  to  decision  level. 
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types  in  .special  p  i'oiIih  1 1- 1  n  c.|\i;;in.t  n>;  t  s !  ah! .  slu:  :c  nl ,  ope  ral  i  <  >  n  ,  and 
support  of  p  i  h  >i  p  r.t'i  m  1 1  e,  lines  it  prove  eapabi  lily  in  p  .•oduce  :  I  ab  ri¬ 
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requ  i  rcnicii!  s:  and  i  h .  -. ;  m!  i  .n  ..*  indies  or  measures  t.>  devise  un¬ 

proved  or  new  ii.aiiMlai  nii'n;;  methods  and  techniques  to  reduce  produc¬ 
tion  costs,  refill*  >  it*  in  I •• . i , ; •  iiii,  .  improve  process  reliability.  or 
as  su  re  in.)  I  e  ne  1  p  rod  in  :b  1 1  1 1  .  A I  i '  a  *  1 1  v  1 1  ie  s  i  n  i!  nil ,  ill*'  Anri  ol 
the  product  i. m  phase  and  overlap  the  developin'  :v  phase,  and  as  such 
arc-  considered  !*'  he  a  n.ninr  <lt  >  isitui  point. 

41.  Technical  Data  I '  a  *  l<  a  g  ■  -  [mj  i  aj_e d.  Preparation  of  a  package, 
consist  mu  ol  drawings,  -pet  il  ie  at  ions,  and  sometimes  (ie  sc  r-pt  ions  nl 
the  processes  needed  lor  mar.ui  act  u  re  ,  is  started.  The  technical  data 
package  has  as  its  am.  the  produiiion  of  the  system  using  conventional 
practices  within  the  capability  *>t  industry,  it  is  usc*d  as  the  basis  tor 
invitation  lor  bid  (If  HI  ol  produetion  contracts. 

XXXVIi.  Proiolype  Testing  and  ! V 1 1 .or. s :  rat  on  Initiated.  Prototype 
tests  io  evaluate  pn  formnne,  a.  m!  <hiiioi-,  s  t  rat  e  re  1 1  abi  1 1 1  y  a  re  initialed. 
Test  results  will  lie  used  to  assess  design  reliability  and  pinpoint  sys¬ 
tem  problem  areas  prior  to  type  classification. 
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42.  R&D  Acceptance  Test  Completed  (3600).  The  R&D  accept¬ 
ance  test  is  conducted  by  or  under  the  control  of  the  responsible 
government  agency  of  an  item  or  system  designed  and  developed  by 

the  contractor  to  insure  that  the  specification  of  the  development  con¬ 
tract  has  been  fulfilled.  The  test  is  completed  when  the  responsible 
government  agency  has  approved  test  results  and  determines  the  sys¬ 
tem  acceptable  for  further  testing.  The  reliability  analysis  of  the 
results  should  be  used  for  guidance  in  the  next  test  series. 

43.  Integrated  ET/ST  Completed  (5100),  The  integrated  en¬ 
gineering  and  service  tests  conducted  by  the  government  are  com¬ 
pleted,  The  objective  of  the  engineering  test  is  to  determine  the 
safety  and  technical  performance  characteristics  of  the  prototypes. 

The  service  test  has  as  its  objective  the  determination  of  whether 
the  system  satisfies  the  QMR  and  is  suitable  for  use  by  the  Army. 

A  reliability  analysis  is  conducted  and  recommendation  formulated 
for  the  IPR. 

XXXVIII.  Integrated  ET/ST  In-Process  Review  Completed  (5200). 

This  review  will  be  held  upon  completion  of  the  integrated  ET/ST  to 
arrive  at  a  recommendation  concerning  adoption  of  the  item  or  sys¬ 
tem  as  standard  or  planned  action  to  remedy  inadequacies  and  de¬ 
ficiencies  found  in  the  test. 

44.  _ Check  Test  Completed  (5900) .  The  che  .<  test  to  prove  out 

corrective  actions  taken  by  the  contractor  on  deficiencies  from  ET/PT 
is  completed.  Test  results  should  be  assessed  to  assure  that  correc¬ 
tive  actions  meet  reliability  requirements  and  that  the  system  is  now 
suitable  for  type  classification.  This  milestone  is  completed  when 

the  final  check  test  report,  is  such  a  test  is  required,  is  forwarded  to 
AMC .  These  reports  indicate  that  the  item  and  all  elements  of  main¬ 
tenance  support  have  been  found  suitable  or  unsuitable  for  Army  use. 

XXXIX.  Type  Classification  Completed  (6000),  Standard  classifica¬ 
tion  designates  the  items  that  have  been  adopted  as  suitable  for  Army 
use,  are  acceptable  as  assets  to  meet  opeiational  requirements,  are 
authorized  for  inclusion  in  equipment  authorization  documents,  and 
are  described  in  published  adopted  items  lists  Completed  upon  ap¬ 
proval  of  AMC  Technical  Committee  action  by  Hec  Iquar ters ,  Depart¬ 
ment.  of  Army. 
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45.  Technical  Data  Package  Preparation  Completed.  A  technical 
data  package,  including  inspection  tables  and  AQL's  to  assure  that  Che 
reliability  demonstrated  in  development  is  kept  during  production,  is 
prepared  for  the  I KB. 

XL.  Invitation  for  Production  Bid  Released.  The  Invitation  for  Bid 
(FB)  or  Request  for  Proposal  (RFP)  for  production  of  the  system  is 
released . 

d.  Production  Phase  (see  figure  B-8) . 

XL1,  Contractor's  Capability  Review  Completed.  After  receipt  of 
bids,  a  production  pr onward  survey  hoard  complete®  assessment  of 
contractor's  capability  to  perform  production  functions  essential  to 
upholding  the  reliability  designed  into  the  item.  Primary  emphasis 
should  be  given  to  the  completeness  of  each  prospective  contractor's 
production  testing  program.  These  tests  are  required  to  assure  that 
the  product  from  production  meets  the  user  reliability  requirements 
and  is  at  least  as  good  as  the  reliability  requirements  expressed  in 
the  QMR  or  the  type  classified  item.  Such  tests  primarily  serve  to 
prevent  production  of  unsatisfactory  products. 

XLII.  Production  Crntract  Awarded  (6500).  This  event  is  the  date,  of 
award  of  a  production  contract  by  the  contracting  officer  after  secur¬ 
ing  required  award  approvals  or  clearances. 

XLIII.  Reliability  Specialist  Assigned  to  Production  Program.  After 
award  of  the  production  contract,  a  reliability  specialist(s)  from  the 
procuring  agency,  knowledgeable  in  the  technical  aspects  of  relia¬ 
bility,  is(are)  assigned  the  responsibility  for  reliability  through  the 
production  phase.  This  assignment  includes  assuring  that  production 
does  in  no  way  reduce  the  reliability  designed  into  the  item. 

XLIV.  Preproduction  Conference  Completed.  The  preproduction  con¬ 
ference  to  clarify  the  contractor's  responsibility  for  meeting  contractual 
requirements,  including  those  relating  to  reliability,  is  completed. 
Primary  emphasis  should  be  given  to  the  contractor's  manner  for  car¬ 
rying  out  production  tests.  It  should  be  pointed  out  by  the  procuring 
agency  that  a  production  testing  sequence  is  required  for  each  pro¬ 
ducer  and  will  usually  be  repeated  whenever  there  is  a  lengthy  delay 
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or  interruption  o;  production,  or  where  major  changes  (engineering 
change  orders'  during  u  rodui  I  ion  are  eflecied.  The  frequency  and 
extent  of  production  tes'ing  will  vary  front  contract  to  contract, 

4b.  Component  Test  Results  Review  Completed.  Components 
fabricated  by  production  techniques  are  tested  and  the  results  re¬ 
viewed  to  assure  reliability  is  nut  abridged.  Testing  is  normally 
conducted  bv  the  contractor. 

4 7 .  Verification  of  AQ1 . 1  s  and  inspection  Tables  Completed. 

A  re  -  inspect  ion  of  accepted  lots  to  verify  that  AQIVs  and  sampling 
tables  are  providing  lots  capable  of  meeting  the  required  reliability 
is  completed. 

48.  Engineering  Change  lost  IU-vi»-w  Completed.  Engineering 
changes  are  tested  as  appropriate  and  the  results  reviewed  to  de¬ 
termine  the  effect  on  system  reliability.  Testing  is  conducted  by 
the  government. 

49.  Records  Review  Initiated.  Alter  the  contractor  makes 
available  all  reliability  records  required  by  the  contract,  an  in-depth 
review  is  initiated, 

50.  Contractor’s  Records  Review  Completed.  The  reliability 
records  of  the  contractor  are  reviewed  against  government  records 
to  assure  potential  problems  have  been  identified  and  steps  taken  to 
preclude  them. 

51.  Analysis  of  Proproduction  Test  Results  Completed.  Results 
of  the  preproduction  lest  are  analyzed.  Reliability  problems  are 
identified  and  trade-oil  recommendations  established  if  necessary. 

XLV,  Trade-Off  Decision  nnr.p'-ned.  Trade-off  decisions  affecting 
reliability  and  based  upon  component  and  prep  roduct  iun  lest  results 
are  completed.  This  decision  should  include  what  reliability  will  be 
traded  with  So  that  the  produced  item  still  will  be  elfective. 

32.  IP  1  Evaluation  Completed.  Initial  production  test  (IPT) 
results  arc  evaluated  to  determine  system  reliability  and  degree  of 
conformance  to  type  classilted  system. 
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53.  Confirmatory  Teat  (Type  I)  Completed  (7500).  A  conf irma- 
tory  type  I  test  of  a  system  is  conducted  to  insure  that  modification 
required  by  corrective  actions  and  trade-offs  are  acceptable.  The 
results  are  to  be  assessed  for  their  impact  on  system  reliability. 

54,  Confirmatory  Test  (Type  II)  Completed  (7700).  A  confirma¬ 
tory  type  II  test  of  a  system  is  used  to  preclude  time-consuming 
retrofit  programs  by  early  and  intensive  use  in  the  field  by  using 
table  of  organization  and  equipment  (TOE)  type  units  to  conduct  the 
test.  The  results  are  to  be  assessed  for  their  impact  on  system 
reliability. 


55.  In-House  Statistical  Analysis  Completed.  A  thorough  pre¬ 
release  data  analysis  of  the  produced  system,  covering  all  aspects  of 
the  production  contractual  documents,  is  completed.  This  analysis 

is  based  on  all  data  from  production  records  and  testing,  the  results 
of  which  are  to  be  used  for  determining  item  suitability  for  release 
to  user.  Carrying  out  of  this  task  is  the  responsibility  of  the  pro¬ 
curing  agency. 

XLVI.  Statistical  Analysis  Review  Completed.  The  in-house  statis¬ 
tical  analysis  is  reviewed  to  determine  if  the  system  meets  the  mini¬ 
mum  requirements  and  is  suitable  for  release  to  the  user. 

XLVII,  Release  Request  Initiated.  Release  of  the  production  item  to 
the  user  if  requested.  This  is  the  date  when  the  first  item  has  been 
accepted  by  the  procuring  agency  and  is  available  for  delivery  to  an 
operational  or  training  activity  with  the  assurance  that  proper  support 
requirements  are  available. 

e.  Operation  and  Disposal  Phases  (see  figure  B-8) . 

XLVIII ■  Release  Completed  (7900).  All  necessary  action  to  release 
the  item  to  the  user  is  completed.  This  event  is  completed  upon  first 
shipment  of  end  item  to  the  overseas  command  or  CONUS  installation 
scheduled  to  receive  the  end  item  in  accordance  with  the  approved 
distribution  plan. 

56.  ICT  Evaluation  Completed.  Inspection  comparison  test  (ICT) 
results  are  evaluated  to  assure  production  reliability  does  not  decrease 
below  limits  of  the  QMR.  This  evaluation  is  the  responsibility  of  the 
production  reliability  specialist. 
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XLIX,  Reliability  Specialist  Assigned  to  Operation  Phase.  After 
release  of  the  system  to  the  user,  a  reliability  specialist,  knowledge¬ 
able  in  the  technical  aspects  of  reliability,  is  assigned  the  responsi¬ 
bility  for  reliability  through  the  operation  phase. 

57.  Field  Reliability  Determined.  Based  on  data  feedback  from 
the  tield  use  of  the  item,  field  reliability  level  is  determined.  This 
information  may  be  useful  for  future  procurement  of  this  item  or  for 
establishment  of  requirements  associated  with  development  of  future 
generation  items. 

58.  Storage  Reliability  Determined.  The  data  from  depot  storage 
inspection  and  depot  maintenance  reports  are  used  to  determine  stor¬ 
age  reliability  level  of  the  item.  The  information  may  also  be  used  as 
input  to  future  procurement  and  development  of  next  generation  items. 

59.  Rebuilt  Equipment  Reliability  Determined.  Field  data  and 
reconditioning  test  results  are  used  to  establish  the  reliability  of  re¬ 
built  equipment. 

60.  Parts  Reliability  Determined.  Data  from  field,  storage, 
and  rebuild  are  cumulated  and  analyzed  to  determine  parts  reliability 
for  history  banks. 

L.  Statistical  History  Review  Completed.  Prior  to  a  second  buy  or 
disposal  action,  the  statistical  history  of  the  system  is  reviewed.  The 
operational  reliability  demonstrated  in  the  field  is  checked  for  para¬ 
metric  deviation  from  production  test  results. 

LI.  Equipment  Disposal  Completed  (87001.  The  point  in  time  when 
disposal  and/or  demilitarization  of  the  system  is  completed. 
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Top  Management  Milestones 


Top  Work  Level 
Management  Milestones 
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I. 

Guidance  Documents  Initiated 

VIII. 

Draft  PropoJ 

II. 

User  Requirements  Established 

4. 

TD1 

III. 

Technological  Forecasting  Completed 

IX. 

TDP  Reliabi 

IV. 

QMDO  Approved  and  Assigned  (0100) 

X. 

Prelim 

inary 

1.  Total  Feasibility  Study  Completed  (0600) 

XI. 

RFP  Initiatej 

2.  Q.VIA  Established 

5. 

Prs 

V. 

TDP  Initiated 

6. 

App 

VI. 

QMR  Initiated 

7. 

Rec 

VII. 

Reliability  Documentat'on  Initiated 

8. 

Tei 

3.  QMR  Reliability  Requirements  Established 

9. 

Tr, 

XII. 

RFP  Approv 

NOTE: 

Completion  of  these  milestones  does  not  require  forma)  zed 

XIII. 

Award  of  Co 

scheduling  other  than  that  required  by  AMCR  11-27. 


Award  of  Contract  Definition  Contracts 


I  AN  AO  ■  MINT  MIL1STON1S 
•flnltlon  Phatt 

Figure  •  86 


X  •  v . 

XV. 

Proposals  Received  and  Review  Initiated 

Organization  Review  Completed 

XIX. 

Rel 

XVI. 

Testing  Program  Review  Completed 

XX. 

r  ra 

XVII. 

Detailed  Reliability  Review  Initiated 

XXI. 

Prc 

10.  Elock  Diagram  Review  Completed 

11.  Standard  Subsystems  Review  Completed 

XXII. 

Coc 

12.  Developmental  Subsystems  Review  Completed 

XX  ill. 

QM 

XVIII. 

13.  Reliability  De sign  Techniques  Evaluation  Completed 

Reliability  Apportionment  Evaluation  Completed 

XX;  V. 

Te< 

14,  History  Check  Evaluation  Completed 

XXV. 

Cp. 

15.  State  of  the  Art  Review  Completed 

XXV:. 

Dr 

16.  Minimum  P.eliability  Evaluation  Completed 
Optimum  Reliability  Evaluation  Completed 
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XIX.  Reliability  Prediction  Accepted 

18.  Trade -Off  Policy  Reliability  Evaluation  Completed 

XX.  Trade-Off  Policy  Accepted 

XXI.  Proposal  Selection  Completed 

XXII.  Coordinated  Test  Procram  Approved  (14001 

19.  QMR  Updated 

XXIII.  QMR  Approved  <0700> 

XXIV,  Technical  Characteristic  1PR  Completeu  (1500) 

20.  TDP  Revised 

XXV.  Updated  TDP  Approved  (0900) 

XXV).  Development  Decision  Made 
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XX  VZi. 
XX  VIU. 

XXIX. 

XXX. 


XXXI. 


Development  Contract  Awarded  (2000) 

Reliability  Specialist  Assigned  to  Development  Program 
Predevelopment  Conference  Completed 

Initiate  Preliminary  Design  Review 

21.  Math  Midel  Evaluation  Completed 

22.  Reliability  Prediction  Review  Completed 

23.  Relial  ilil,  Apportionment  Review  Completed 

24.  Potential  Problem  Action  Evaluation  Completed 

25.  Review  and  Recommendation  Completed 
Engineering  Concept  In-Process  Review  Completed  (1700) 


XXXII.  Initiate  Engines 

26.  First  Hard 

27.  Corrective 

28.  GFE  Docui 

29.  Math  Mode 

< 

30.  Reliabilityj 

1 

31.  Reliability] 

32.  Maintenam 
3  3.  Recommer 

XXXIII.  Design  Characters 


NOTE:  Completion  of  these  milestones  does  not  require  formalized 
scheduling  other  than  that  required  by  AMCR  11-27. 


Development 

Figure  P-7 


Initiate  Engineering  Design  Review 

26.  First  Hardware  Assessment  Completed 

27.  Corrective  Action  Verification  Completed 
f  28.  GFE  Document  Completed 

29.  Mith  Model  Review  Completed 

t 

|  30.  Reliability  Prediction  Review  Completed 
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34.  Engineering  Desmn  Testing  Completed  (2900)  4l>  Technical  Data 

35.  Ent.nccrut  Desifin  Testing  Results  Analysis  Completed  XXXVII.  Prototype  Testing  Imtiatet 

36.  Probable  Failure  Modes  Review  Completed  42  Rf<D  Acceptance  ' 
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XLI.  Contractor's  Capability  Review  Completed 
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XLU.  Production  Contract  Awarded  (6500) 


XLLU.  Reliability  Specialist  Assigned  to  Production  Program 
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XLV.  Trade-Off  Decision  Completed 
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XLVIU.  Release  Completed  (7d00) 

id.  ICT  Evaluation  Completed 
XL1X.  Reliability  Specialist  Assigned  to  Operation  Phase 

57.  Field  Reliability  Determined 
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D.  Statistical  History  Review  Cc 
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APPENDIX  C 

TECHNICAL  REQUIREMENTS  ANALYSIS  AND 
DOCUMENTATION  OF  RELIABILITY  REQUIREMENTS 

Section  I.  INTRODUCTION 

C-l.  General.  The  contents  of  this  appendix  are  intended  to  provide 
the  reader  with  guidance  for  implementation  of  the  discussions  in 
chapter  3.  In  addition  to  examples,  it  provides  information  explain¬ 
ing  how  reliability  requirements  should  be  stated  in  QMR's/SDR's. 

A  discussion  of  the  relationship  between  reliability  and  incentive  con¬ 
tracting  is  also  included. 

Section  II.  COMMENTS  ON  TYPICAL  FAULTS 
IN  STATING  RELIABILITY  REQUIREMENTS 
IN  QMR's/SDR's 

C-2.  Examples.  The  following  examples  represent  typical  cases  as 
to  how  reliability  requirements  have  been  stated  in  QMR's  and  SDR's. 
Following  each  example  are  comments  which  critique  the  example  and 
state  ways  of  improving  the  requirement.  When  writing  reliability  re¬ 
quirements  in  QMR's/SDR's,  the  following  may  be  used  at  guidance: 

a.  Draft  Proposed  QMR  for  Automatic  Test  Equipment  for 
Communications  Electronic  Material: 

(1)  Requirement:  The  mission  duration  for  ATE/C-E  at 
all  maintenance  levels  will  be  eight  hours  of  operation.  Assuming  an 
exponential  failure  distribution,  a  mission  reliability  for  a  mean  time 
between  failures  IMTBF)  of  100  hours  would  be  92.  3%. 

(2)  Comment:  Weakness  is  exhibited  in  three  elements 
of  this  requirements  paragraph. 

(a)  The  requirement,  as  stated,  is  not  a  requirement 
but  merely  a  statement  of  mathematical  fact  under  the  assumption  of 
an  8-hour  mission  duration  and  an  exponential  distribution  of  failure 
time  s. 
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(b)  There  are  two  possible  interpretations  of  the 
word  failure.  First,  a  failure  could  be  defined  as  the  inability  of  the 
tester  to  detect  the  fault  when  a  fault  exists.  On  the  other  hand,  it 
could  be  defined  as  a  false  detection  of  a  nonexistent  fault.  It  could 
also  be  both.  This  should  be  explicitly  defined  in  order  for  the  re¬ 
liability  requirement  to  be  meaningful. 

(c)  At  this  point  of  the  life  cycle,  mission  reliability 
should  be  expressed  as  a  probability  and  not  in  terms  of  MTBF ;  i.e.  , 
it  is  premature  to  assume  the  distribution  of  failure  times  to  be  ex¬ 
ponential  or  any  other  distribution. 

b.  Draft  Proposed  SDR  for  a  Short  Range  Mission  Radio  Set; 

(1)  Requirement:  Mission  reliability:  100%  capable  of 
performing  a  mission  over  a  twelve-hour  period  without  changing 
batteries  when  transmitting  one  minute  out  of  erery  ten. 

(2)  Comment:  Reliability  may  be  considered  to  be  proba¬ 
bility  of  successful  operation  for  the  time  period  indicated.  In  this 
context,  the  requirement  as  stated  is  impossible  to  comply  with.  All 
items  have  some  distinct  possibility  of  failing  during  any  given  period 
of  operating  time,  and  this  possibility  has  been  ruled  out  by  the  state¬ 
ment  above. 

c.  Draft  Proposed  SDR  for  Cold  Water  Detergents: 

(1)  Requirement: 

(a)  Mission  reliability:  99%. 

(b)  Availability  (Combat  Ready  Rate):  99%. 

(c)  Reliability  after  storage:  97%  after  two  years' 

storage. 


(?)  Comment:  The  quantitative  requirements  pertaining 
to  mission  reliability,  availability,  and  reliability  after  storage  should 
be  deleted  in  each  case.  These  parameters  arc  not  applicable  in  the 
frame  of  reference  intended  by  AR  705-50. 
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d.  Draft  Proposed  SDR  for  Forward  Area  Air  Defense  Alert 
Radar  (FAAR): 

(1)  Requirement:  The  inherent  equipment  reliability  shall 

provide  as  a  minimum  a  reliability  of _ %  for  a  critical  time  of _ 

hours  and  mean  time  between  failures  (MTBF)  of _ hours. 

(2)  Comment:  Only  one  of  the  parameters  required  to  be 
included  in  QMR/SDR  by  AR  705  -50  was  specifically  identified  in  this 
SDR,  and  this  requirement  (reliability)  is  stated  in  such  a  manner 
that  it  would  be  impossible  to  comply  with;  i.e.  ,  the  mission  duration, 
reliability  requirement,  and  MTBF  were  mutually  incompatible. 

C - 3 .  Review  of  reliability  requirements  in  QMR'a  and  SDR's.  The 
following  should  be  considered  when  reviewing  reliability  requirements 
in  QMR's  and  SDR's  to  determine  their  technical  adequacy  and  feasi¬ 
bility  of  attainment.  Maximum  coordination  with  counterparts  at 
USACDC  is  encouraged  in  connection  with  making  this  determination. 

a.  The  document  should  include  a  statement  relative  to  what 
constitutes  a  failure.  Since  the  word  reliability  normally  implies 
probability  of  successful  operation  (nonfailures)  for  a  specified  period 
of  time,  it  can  only  take  on  true  meaning  if  failure  is  defined. 

b.  The  mission  duration  should  be  defined.  Often  QMR's  and 
SDR's  include  a  vague  statement,  such  as  the  mission  duration  will 
vary  depending  upon  a  number  of  influencing  factors.  Yet,  many  of 
these  same  documents  include  a  quantitative,  minimum  reliability  re¬ 
quirement  identified  as  being  essential.  Again,  since  reliability  nor¬ 
mally  means  probability  of  successful  operation  for  a  specified  period 
of  time,  it  is  relatively  meaningless  to  include  a  quantitative  reliability 
requirement  unless  it  is  associated  with  a  definite  period  of  time 
(mission  duration),  with  the  obvious  exception  of  nortime  dependent 
devices  such  as  one-shet  devices,  (e.g.,  munitions). 

c.  There  should  not  be  a  statement  associating  a  quantitative 
level  of  statistical  confidence  with  the  reliability  requirement,  such 
ac:  "the  minimum  acceptable  reliability  ehall  be  95%  to  be  demon¬ 
strated  at  a  90%  confidence  level.  "  Degree  of  confidence  is  deter¬ 
mined  when  designing  the  test  plan  and,  as  such,  is  influenced  by 
factors  such  as  cost,  time,  and  required  precision  of  test  results. 
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To  specify  it  in  a  QMR  or  SDR  as  a  requirement  that  must  be  met  in 
association  with  a  reliability  requirement  is  premature.  It  should 
suffice  that  a  quantitative  reliability  requirement  be  specified  in  the 
QMR/SDR. 

d.  Reliability  requirements  should  neither  be  too  lax  nor 
too  stringent.  They  are  seldom  too  lax,  but  often  too  stringent  and 
in  some  cases,  literally  impossible  to  attain  and  verify.  A  critical 
analysis  should  therefore  be  made  on  a  case -by-case  basis  to  deter¬ 
mine  the  feasibility  of  attaining  and  verifying  the  achievement  of  the 
reliability  requirements  within  the  current  or  projected  state  of  the 
art  and  within  time  and  cost  constraints. 

e.  Analysis  of  the  reliability  requirements  in  QMR's  and 
SDR's  should  include  a  determination  whether  all  of  the  appropriate 
requirements  of  AR  705-50  have  been  considered.  Two  of  the  most 
repetitive  faults  of  QMR's  and  SDR's  are  the  exclusion  of  these  re¬ 
quirements  when  they  are  applicable  and  the  inclusion  of  these  require¬ 
ments  if  they  are  not  applicable.  Consequently,  an  analysis  should  be 
made  to  determine  whether  the  requirements  set  forth  by  AR  705-  50 
are  applicable  for  the  particular  item  described  by  the  documents 

and,  if  so,  whether  or  not  they  have  been  included. 

f.  If  a  quantitative  requirement  is  included,  that  is,  identified 
as  being  the  durability  requirement  for  the  item,  the  definition  of  dura¬ 
bility  as  it  applies  to  the  item  should  be  included.  The  reason  for  this 
is  that  a  great  deal  of  confusion  exists  relative  to  what  durability  means. 
AR  705-50  does  not  require  that  a  durability  requirement  be  included 

in  QMR's  and  SDR's.  and  the  DoD  standard  for  definitions  of  reliability 
terms  (MIL-STD-721B)  does  not  include  a  definition  of  durability,  yet 
a  durability  requirement  sometimes  appears  in  QMR's  and  SDR's,  par¬ 
ticularly  in  the  "priority  of  characteristics"  section  contained  therein. 

It  should  either  be  omitted  or  be  precisely  defined  in  the  document. 

g.  The  requirements  should  be  quantitatively  expressed  in 
terms  that  are  mutually  understandable  to  both  the  user  and  developer. 
Reliability  requirements  are  generally  expressed  in  terms  of  proba¬ 
bility  of  successful  operation  for  the  duration  of  the  mission  by  means 
of  percentages  or  equivalent  decimal  fractions.  However,  there  may 
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be  a  few  situations  where  it  is  considered  more  feasible  to  express 
the  requirement  in  other  terms,  such  as  mean  time  between  failures 
(MTBF),  or  probability  of  correct  functioning  for  one-shot  devices, 
etc.  It  should  be  noted,  however,  that  it  is  not  considered  appropriate 
to  express  a  given  requirement  as  both  a  probability  and  an  MTBF, 
such  as:  "The  mission  reliability  will  be  no  less  than  85%  for  a  10- 
hour  mission  with  an  MTBF  of  62  hours.  "  For  this  example,  if  the 
failure  rate  were  determined  to  be  approximately  constant  (and  this 
cannot  be  verified  until  items  are  built  and  operated  a  sufficient  length 
of  time  to  determine  the  distribution  of  failure  times',  the  MTBF  and 
percentage  value  arc  redundant.  If  the  failure  rate  is  not  constant, 
the  percentage  value  and  the  MTBF  arc  incompatible. 

Section  III.  STATING  THE  RELIABILITY  CLAUSE  IN  CONTRACTS 

C-4.  General.  Presently  there  is  much  concern  over  the  general 
inadequacy  of  contractual  provisions  for  the  assurance  of  equipment 
reliability.  The  DoD  has  emphasized  the  use  of  incentive-type  con¬ 
tracts  whenever  possible-  in  lieu  of  the  traditional  cost -plus -fixed -fee 
(CPFf  )  contracts  tor  procurement  of  equipment.  The  purpose  of  this 
discussion,  then,  is  twofold:  (11  to  provide  the  procuring  agency  with 
guidance  on  the  inclusion  of  certain  contractual  provisions  which  em¬ 
phasize  contractor  obligations  associated  with  attainment  of  specified 
equipment  reliability;  and  (2)  to  provide  general  guidelines  for  stiou- 
lating  reliability  incentive  requirements  and  identify  certain  technical 
problems  that  arise  in  the  process  of  doing  so. 

C-5.  Reliability  clause  lor  development  contracts,  a.  AR  705-50 
requires  that  all  equipment  con*  racts  will  contain  minimum  numerical 
reliability  requirements  (minimum  acceptable  reliabil.iy  levels). 
Additionally,  it  is  required  that  contractual  provisions  include  the 
requirement  for  demonstration  of  stated  quantitative  requirements  at 
selected  program  milestones. 

b.  In  addition,  Military  Standard  785  and  AR  705-50  state 
that  reliability  tests,  evaluations,  or  measurements  will  be  conducted 
under  conditions  specified  by  the  proposal  or  any  subsequent  test  pian 
approved  by  competent  authority.  If  contractual  reliability  require¬ 
ments  are  not  met  during  demonstration  tests,  the  deficient  portions 
of  the  system  must  be  redesigned  and  demonstration  Lests  continued 
or  repeated  to  verify  that  acceptance  reliability  has  been  achieved. 
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c.  Insomuch  as  Military  Standard  785  and  AR  705-50  require 
of  procuring  activities  that  appropriate  reliability  requirements  be 
included  in  contractual  documentation,  it  remains  for  the  procuring 
agency  to  assure  that  these  requirements,  in  fact,  are  included. 

This  requires  that  numerical  requirements  and  demonstration  of  these 
requirements  are  clearly  stipulated;  it  requires  that  alternatives  are 
provided  which  specify  courses  of  action  upon  noncompliance,  (e.g.  , 
rejections  and  retest). 

C-6.  Reliability  requirements  in  production  contracts,  a.  The 
following  information  is  to  provide  the  reader  with  an  example  as  to 
how  reliability  should  be  stated  as  part  of  the  production  contract  re¬ 
quirements  . 

b.  Example. 

(1)  Section  _ ,  Requirements.  Paragraph  _ ,  Relia¬ 

bility.  Machine  guns  shall  be  capable  of  passing  a  30,000  round  re¬ 
liability  test  as  specified  in  paragraphs  _ and  _ with  no  service¬ 

able  parts  and  not  more  than  a  total  of  two  machine  gun  malfunctions 
for  the  entire  test.  In  addition,  each  machine  gun  shall  meet  tne 
acceleration  time,  steady  state  rate,  and  stopping  time  requirements 
specified  in  table  I. 


Table  I.  Performance  Requirements 


Machine  gun 
torque  at 
minimum 
steady  state 
rate  of  fire. 

Acceleration  time 
(from  the  time  of 
application  of  cur¬ 
rent  to  the  drive 
motor  to  the  time 
minimum  steady 
state  rate  of  fire 
is  reached). 

Steady  state 
rate  of  fire 
(ave  rage 
rounds  per 
minute  fired). 

Stopping  time 
(from  the  time 
current  is  re¬ 
moved  from  the 
drive  motor  un¬ 
til  the  machine 
gun  comes  to  a 
complete  stop). 

High 

180  pound- 

0.  4  seconds  (max.  ) 

6,  000  to 

0.  2  seconds  to 

rate 

’  nches  (max.  ) 

6,  400 

0.  5  seconds 

.Low 

105  pound- 

0.  4  seconds  (max.  ) 

2,  000  to 

0.  2  seconds  to 

rate 

inches  (max.  ) 

2,  500 

0.  5  seconds 
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(2)  Section  _ ,  Quality  Assurance  Provisions.  Para¬ 
graph  _ ,  Reliability  Testing. 

Paragraph  _ ,  Lot  Size.  The  initial  reliability  test  lot  size  shall 

consist  of  the  iniliaL  month's  production;  subsequent  reliability  test 
lot  sizes  shall  consist  of  100  machine  guns.  When  five  successive 
lots  meet  the  requirements,  the  reliability  test  lot  size  shall  be  in¬ 
creased  to  200  machine  guns. 

Paragraph  _ ,  Procedure.  Machine  guns  selected  by  the  government 

representative  from  each  reliability  lot  shall  be  tested  by  the  contrac¬ 
tor  for  reliability'  using  the  test  method  specified  in  paragraph  .  If 
the  reliability  requirements  arc  not  met,  the  represented  lot  shall  be 
rejected  subject  to  retest  or  reconditioning  and  further  lest  as  a  re¬ 
conditioned  lot.  A  reliability  retest  of  machine  guns  from  the 
same  lot  shall  be  made  Without  reconditioning  the  represented  lot, 
unless  in  the  opinion  of  the  government  representative  the  failure  indi¬ 
cates  serious  defects  in  the  item,  in  which  case  retest  shall  be  made 
only  if  authorized  by  the  procuring  agency.  Failure  of  the  machine 
guns  in  the  retest  to  meet  the  requirements  shall  cause  rejection  of 
the  represented  lot  subject  to  reconditioning  and  further  testing  as  a 
reconditioned  lot.  Prior  te  submission  of  a  lot  of  machine  guns  as 
a  reconditioned  lot,  the  cause  of  failure  shall  be  determined  and  con¬ 
tractor  correction  shall  be  effected  on  all  machine  guns  in  the  lot. 
Sample  size  and  test  methods  for  reconditioned  lots  shall  be  the  same 
as  tor  retest. 

Paragraph  _ ,  Reliability  Test. 

Paragraph  _ .  Testing  of  machine  guns  for  reliability  requirements 

(see  section  _ )  shall  be  accomplished  with  the  machine  gun  held  in 

a  mount  using  the  ammunition  Iced  system,  calibrated  drive  (for  high 
rate),  power  supply,  and  in  instrumentation  in  accordance  with  descrip¬ 
tion. 

Paragraph  _ .  Testing  shall  be  accomplished  using  ball  cartridges 

in  belts  of  1500  rounds  each.  The  machine  gun  shall  be  fired  using  ten 
bursts  of  150  round  each  at  a  steady  state  rate  of  6000  to  6400  rounds 
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per  minute.  Acceleration  and  stopping  time,  torque,  and  steady 
state  rate  of  fire  shall  be  measured  and  recorded  on  the  last  burst 
of  each  1500-round  belt.  These  recorded  values  shall  be  forwarded 
in  accordance  with  paragraph _ . 

Paragraph _ .  After  each  150-round  burst,  the  machine  gun  shall 

be  allowed  to  cool  (without  cooling  aids)  for  5  to  15  seconds.  After 
each  1500-round  belt,  the  machine  gun  shall  be  cooled  to  within  25°  F. 
of  ambient  room  temperature  (using  cooling  aids  other  than  water). 

After  each  3000  rounds,  the  machine  gun  shall  be  examined  and  lubri¬ 
cated  as  necessary.  Parts  removed  from  the  machine  gun  during 
examination  shall  be  replaced  in  original  firing  position  from  which 
they  were  removed.  Headspace  and  breech  lock  gap  shall  be  ex¬ 
amined  at  the  start  of  the  test  and  at  the  end  of  the  test  on  the  cleaned 
and  unlubricaced  machine  gun.  At  the  end  of  each  day's  firing,  the 
machine  gun  shall  be  protected  against  corrosion. 

Paragraph  _ .  No  alteration  or  replacement  of  parts  shall  be  made 

unless  the  parts  are  either  broken  or  worn  to  the  extent  that  they  are 
unserviceable.  An  unserviceable  part  is  one  that  causes  malfunctions 
or  impairs  the  safety  of  the  machine  gun.  A  complete  record  shall  be 
kept  for  each  reliability  test,  showing  each  malfunction  and  all  parts 
replaced  including  the  number  of  the  machine  gun  round  at  which  they 
occurred. 

Paragraph _  .  The  contractor  shall  investigate  causes  of  malfunc¬ 

tions  and  unserviceable  parts  and  indicate  corrective  action  taken. 

Paragraph _ .  Reliability  tested  machine  guns  and  parts  shall  be 

disposed  of  as  specified  in  the  procurement  documents. 

Section  IV.  INCENTIVE  CONTRACTING 

C-7.  General,  a.  Increased  emphasis  is  being  placed  on  the  use 
of  incentive  contracts,  especially  in  lieu  of  cost-plus-fixed-fee  con¬ 
tracts.  DoD  Incentive  Contracting  Guide  (FM  38-34)  provides  guidance 
for  the  use  of  incentive  contracting.  While  most  of  what  follows  applies 
to  incentive  contracting  in  general,  much  of  it  is  applicable  to  reliability 
incentives  in  particular. 
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b.  A  rapidly  changing  technology  and  expanding  requirements 
for  more  complex  systems  has  radically  altered  the  character  and 
function  of  military  materiel,  No  longer  is  military  research  and  de¬ 
velopment  typically  the  low  cost  predecessor  of  large,  multi-year 
production  runs  of  items  with  relatively  stable  designs,  tr.  many 
cases,  the  hardware  evolved  during  an  R&D  effort  becomes  the  sys¬ 
tem  specified  for  operational  deployment.  No  longer,  for  many  mili¬ 
tary  systems,  is  the  injunction,  "Make  it  like  the  drawing  shows,  " 
adequate  guidance  for  obtaining  satisfactory  system  performance  and 
life  during  the  production  phase.  No  longer  can  military  systems  be 
maintained  satisfactorily  by  the  using  troops;  highly  trained  and  skilled 
maintenance  personnel  are  required.  These  changes  have  made  the 
contractors'  trade-off  decisions  important  to  the  overall  cost  to  the 
Army  of  military  systems. 

c.  One  effective  means  of  motivating  a  contractor  to  make 
these  trade-off  decisions  amongst  cost,  schedules,  and  the  various 
performance  characteristics  (including  reliability)  which  the  Army 
desires,  is  the  use  of  properly  structured  incentive  contracts.  That 
is,  a  properly  structured  incentive  contract,  through  the  use  of  re¬ 
wards  and  penalties,  will  motivate  the  contractor  to  make  the  same 
trade-off  decisions  that  the  Army  would  if  it  were  doing  the  work  itself. 

C-8.  Incentive  contracting  principles.  If  an  incentive  contract  is  to 
be  effective  and  to  yield  an  acceptable  product,  (e.  g.  ,  technical  data 
package,  hardware,  services),  seve ral  principles  should  be  observed. 
First,  the  contract  terms  must  be  clear,  complete  and  unambiguous; 
these  conditions  are  especially  important  in  stating  the  incentive  pro¬ 
visions.  Second,  nothing  in  the  incentive  provisions  should  permit 
the  contractor  to  meet  his  contractual  obligations  unless  the  perform¬ 
ance  meets  all  of  the  minimum  requirements  of  the  contract.  Third, 
incentive  payments  for  changes  in  levels  of  performance  should  be 
offered  only  if  the  Army  can  be  expected  to  benefit  from  such  changes 
and  the  contractor  has  the  ability  and  authority  to  cause  such  changes; 
similarly,  incentive  deductions  for  changes  in  levels  of  performance 
should  be  required  only  if  the  Army  can  be  expected  to  be  adversely 
affected  by  such  changes  and  the  contractor  has  the  ability  and  authority 
to  prevent  such  changes.  Fourth,  the  magnitudes  of  the  maximum  pos¬ 
sible  incentive  payment  and  of  the  maximum  possible  incentive  deduction 
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should  reflect  both  the  risk  taken  by  the  contractor  and  the  magnitudes 
of  the  benefit  to  the  Army  of  optimum  contract  performance  and  of  the 
loss  to  the  Army  of  minimum  acceptable  performance  as  compared  to 
target  level  performance.  Fifth,  the  number  of  performance  charac¬ 
teristics  covered  by  the  incentive  provisions  should  be  kept  small; 
each  additional  characteristic  considered  dilutes  the  impact  of  the 
incentive  and  lessens  the  probability  of  the  contractor  making  the 
trade-off  decisions  most  beneficial  to  the  Army.  Finally,  the  struc¬ 
tures  of  the  incentive  provisions  should  be  kept  as  simple  as  practical; 
the  object  is  to  motivate  the  contractor,  not  to  impress  him  with  the 
erudition  of  Army  personnel. 

C-9.  Structuring  incentive  provisions,  a.  The  first  step  in  struc¬ 
turing  incentive  provisions  is  to  determine  which  performance  charac¬ 
teristics  to  consider  for  inclusion.  Only  those  characteristics  should 
be  considered  whose  levels  are  dependent  mainly  on  the  contractor's 
actions  and  whose  levels  determine  or  help  determine  the  value  of  the 
contract  product  to  the  Army.  If  the  contractor  is  unable  to  change 
the  performance  level  of  a  characteristic  because  of  conditions  beyond 
his  control,  inclusion  of  the  characteristic  in  the  incentive  provisions 
frustrates  the  contractor  and  reduces  his  motivation.  If  the  perform¬ 
ance  level  of  a  characteristic  does  not  affect  the  value  of  the  contract 
product  to  the  Army,  inclusion  of  the  characteristic  in  the  incentive 
provisions  wastes  the  contractor's  efforts  and  the  Army's  money. 

b.  The  second  step  in  structuring  incentive  provisions  is  to 
determine,  for  each  performance  characteristic  considered,  what 
level  of  performance  is  to  be  sought  (i.e.  ,  the  target  level),  what  level 
of  performance  is  the  worst  acceptable,  and  what  level  of  performance 
is  the  best  which  can  be  reached  under  the  current  state  of  the  art  (i.e.  , 
the  optimum  level).  The  optimum  level  must  be  feasible.  In  those 
instances  where  the  value  of  the  contract  product  does  not  decrease 
after  a  certain  performance  level  below  the  target  level  is  reached, 
that  certain  level,  for  purposes  of  what  follows,  is  the  worst  accept¬ 
able  level.  Similarly,  in  those  instances  where  the  value  of  the  con¬ 
tract  product  does  not  increase  after  a  certain  performance  level 
above  the  target  level  is  reached,  that  certain  level  is  the  optimum 
level. 
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c.  The  third  step  is  to  determine  the  differences  in  value  to 
the  Army,  for  each  performance  characteristic  considered,  between 
optimum  level  and  target  level  and  between  target  level  and  worst 
acceptable  level.  For  most  performance  characteristics,  other  than 
cost,  these  differences  will  be  estimates  rather  than  exact.  For  ex¬ 
ample,  if  reliability  is  one  of  the  performance  characteristics  con¬ 
sidered,  one  approach  to  estimating  the  differences  is  to  consider  how 
many  more  items  would  be  needed  if  the  reliability  were  at  the  worst 
acceptable  level  instead  of  at  target  level  and  how  many  fewer  items 
would  be  needed  if  the  reliability  were  at  the  optimum  level  instead  of 
at  the  target  level  and  to  multiply  these  changes  each  by  the  target 
per-item-cost.  Assuming  that  the  impact  of  reliability  upon  procure¬ 
ment  costs  is  several  times  that  upon  other  costs,  then  the  computed 
changes  in  value  are  accurate  enough  for  use  in  structuring  the  incen¬ 
tive  provisions. 

d.  The  fourth  step  is  to  find  the  total  difference  in  value 
between  having  all  the  characteristics  at  their  optimum  level  and  hav¬ 
ing  all  the  characteristics  at  their  target  level  and  the  total  difference 
in  value  between  having  all  the  characteristics  at  their  target  level 
and  having  all  the  characteristics  at  tneir  worst  acceptable  level. 

Each  difference  in  value  found  in  £  between  optimum  level  performance 
and  target  level  performance  is  divided  by  the  first  difference  to  find 
the  proportion  of  the  maximum  allowable  incentive  payment  to  be  al¬ 
located  to  the  corresponding  characteristic.  Similarly,  each  difference 
in  value  found  in  c_  between  target  level  performance  a. id  worst  accept¬ 
able  level  performance  is  divided  by  the  second  difference  to  find  the 
proportion  of  the  maximum  incentive  deduction  to  be  allocated  to  the 
corresponding  characteristic. 

e.  The  fifth  step  is  to  relate  achieved  performance  level  for 
each  characteristic  to  incentive  payment  or  deduction.  The  relation¬ 
ship  between  performance  level  and  incentive  payment  or  deduction 
should  be  the  same  type  as  the  relationship  between  performance  level 
and  value.  Usually,  the  performance  level-incentive  relationship 
changes  at  the  target  level  since  the  two  sets  of  proportions  found  in  d 
usually  are  not  the  same.  Types  of  possible  relationships  include 
linear,  exponential  and  step;  a  linear  relationship  may  be  applied  to 
fraction  defective  when  this  is  small;  an  exponential  relationship  may 
be  applied  to  reliability  when  level  is  measured  in  mean  time  between 
failures;  a  step  relationship  may  be  used  for  such  characteristics  as 
schedules. 
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f.  The  sixth  step  is  to  determine  what  evidence  is  to  be  used 
to  measure  the  level  of  performance  for  each  characteristic.  For  re¬ 
liability,  this  includes  the  sampling  plans,  estimates  and  test  methods, 
and  conditions  to  be  used.  The  sampling  plans  selected  should  reflect 
a  good  balance  between  test  cost  ami  cost  of  a  wrong  estimate  of  per¬ 
formance  Level. 

g.  The  final  step  is  to  convert  the  results  of  the  preceding 
steps  into  the  incentive  provisions  for  the  contract.  These  provisions 
must  state  in  clear  and  unambiguous  terms  exactly  how  the  incentive 
payment(s)  and  deduction(s)  are  <o  be  determined. 

h.  As  the  structure  of  the  incentive  provisions  evolves,  judg¬ 
ment  and  experience  may  dictate  that  one  or  more  of  the  characteris¬ 
tics  be  dropped  or  changed  to  achieve  more  effective  incentive  pro¬ 
visions;  this  should  be  done  and  the  appropriate  steps  repeated  using 
the  new  set  of  characteristics. 

C-10.  Example .  a.  Consider  a  program  to  develop  a  nonrepayable 
item  having  the  following  expected  characteristics: 

(1)  Item  failure  rate  remains  constant  with  time. 

(2)  Mission  duration  will  be  21  hours. 

(3)  Cost  per  production  unit  will  be  $36,  000. 

(4)  At  the  target  reliability  Level  of  90<ro,  an  initial  pro¬ 
duction  run  of  500  units  is  required. 

(5)  Each  week's  delay  in  completing  the  development  of 
the  item  costs  the  Army  $5000. 

Because  a  cost-plus-incentive-fee  contract  was  to  be  used  to  cover 
the  development  of  the  item,  the  performance  characteristics  selected 
for  consideration  were:  contract  cost,  item  reliability,  and  contract 

duration. 

b.  The  three  characteristics  were  studied  to  find  their  three 
key  levels. 
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(1)  The  cost  analysts  arrived  at  a  target  contract  cost  of 
$12,  000,  000;  a  minimum  feasible  (or  optimum)  contract  cost  of 

$10,  000,  000:  and  a  maximum  allowable  (or  worst  acceptable)  contract 
cost  of  $15,  000, 000. 

(2)  Engineering  analysis  indicated  a  maximum  feasible 
(or  optimum)  mean  time  to  failure  of  2100  hours  (or  an  optimum  re¬ 
liability  of  99%)  and  a  minimum  allowable  (worst  acceptable)  mean 
time  to  failure  of  164  hours  (or  a  worst  acceptable  reliability  of  80%). 
The  target  reliability  of  90%  is  equivalent  to  a  mean  time  to  failure  of 
(21  hours)/(-ln  0.  9)  or  199.  32  hours. 

(3)  Application  of  PER.T  to  the  work  to  be  accomplished 
indicated  that  the  contract  would  take  at  least  36  weeks  from  start  to 
finish,  was  expected  to  have  a  duration  of  52  weeks,  and  would  be  com¬ 
pleted  in  no  more  than  68  weeks  after  its  start.  Therefore,  the  target 
contract  duration  was  set  at  52  weeks;  the  optimum  contract  duration 
was  set  at  36  weeks;  and  the  worst  acceptable  contract  duration  was 
set  at  68  weeks. 

c.  Further  study  was  made  of  the  impact  of  the  three  key 
levels  of  each  characteristic. 

(1)  Little  additional  study  was  needed  to  show  that  the  value 
to  the  Army  of  the  optimum  contract  cost  rather  than  the  target  contract 
cost  would  be  $12,  000,  000  -  $10,  000,  000,  or  $2,  000,  000,  and  that  the 
value  to  the  Army  of  the  target  contract  cost  rather  than  the  worst  ac¬ 
ceptable  contract  cost  would  be  $15,000,000  -  $12,000,000,  or 

$3,  000,  000. 

(2)  Further  study  of  the  reliability  levels  revealed  that  if 
the  item  reliability  were  equal  to  90%,  the  target  level,  the  initial  pro¬ 
duction  run  of  500  units  could  be  expected  to  complete  (0.  90)(500),  or 
450  successful  missions.  Also,  it  was  found  that  if  the  item  reliability 
were  equal  to  80%,  the  worst  acceptable  level,  450  successful  missions 
would  require  on  the  average  (450)/ (0,  80),  or  (rounding  upward)  563 
units  and,  if  the  item  reliability  were  equal  to  99%,  the  optimum  ievel, 
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450  successful  missions  would  require  on  the  average  (450)/(0.  99), 
or  (rounding  upward)  455  units.  At  $36,000  per  unit,  the  value  to 
the  Army  of  the  optimum  reliability  level  rather  than  the  target  re¬ 
liability  level  was  found  to  be  (500-455)($36,  000),  or  $1,  620,  000, 
and  the  value  to  the  Army  of  the  target  reliability  level  rather  than 
the  worst  acceptable  reliability  level  was  found  to  be  (563-500) 

($36,  000),  or  $2,  268,000. 

(3)  Based  on  $5,  000  per  week  saving  for  speedy  contract 
completion,  the  value  to  the  Army  of  the  optimum  contract  duration 
rather  than  the  target  contract  duration  was  found  to  be  (52- 16)($5000), 
or  $80,000,  and  the  value  to  the  Army  of  the  target  contract  duration 
rather  than  the  worst  acceptable  contract  duration  was  found  to  be 
(68-52)($5000),  or  $80,000. 

d.  The  total  differences  in  value  and  the  allocations  which 
were  found  are  shown  in  figure  C-10. 


Optimum 

-Target 

Target-Worst  Acceptable  i 

Characteristic 

Amount 

Allocation 

Amount 

Allocation 

Contract  Cost 

$2,  000,  000 

54.  05% 

$3, 000, 000 

56.  10% 

Reliability 

1,  620,  000 

43.  78 

2,  268,  000 

42.  41 

Contract  Duration 

80,  000 

2.  16 

80, 000 

1.  50 

Total 

$3,  700,  000 

99.  99% 

$5,  348,  000 

100. 01% 

F igure  C -  10 

Table  of  Values  and  Allocations 

At  this  stage,  consideration  was  given  to  dropping  the  characteristic, 
contract  duration,  because  of  its  small  allocations;  retention  of  the 
characteristic  was  decided  upon  because  only  three  characteristics 
were  under  consideration  and  inclusion  would  serve  to  indicate  the 
Army's  active  interest  in  the  characteristic. 
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e.  Based  upon  the  judgment  of  the  negotiator  who  was  to  ne¬ 
gotiate  the  contract  for  the  item,  a  maximum  allowable  incentive  pay¬ 
ment  of  $1,  200,  000  and  a  maximum  incentive  deduction  of  $600,  000 
were  selected  for  use  in  setting  up  the  incentive  structure.  When  the 
final  contract  was  written,  the  structure  was  adjusted  easily  by  multi¬ 
plying  the  incentive  rates  by  the  appropriate  constant. 

(1)  The  contract  cost  incentive  structure  was  set  at 
(0 .  5405) ($1 ,  200,  000)  / (2000) ,  or  $324.  30,  incentive  paid  for  every 
$1000  that  the  contract  cost  fell  below  $12.  000,  000,  and  (0.  5610) 

($600,  000)  / ( 3000) ,  or  $112.20,  incentive  deducted  for  every  $1000 
that  the  contract  cost  exceeded  $12,000,000.  Any  incentive  payment 
earned  for  contract  cost  was  to  be  added  to  the  target  fee  and  any  other 
incentive  payments;  any  incentive  deduction  for  contract  cost  was  to  be 
deducted  from  the  target  fee  and  any  incentive  payments.  (Essentially, 
this  structure  is  that  of  two  straight  lines,  since  there  are  2000  possible 
payment  steps  and  3000  deduction  steps.  1 

(2)  The  reliability  incentive  structure  required  the  most 
study.  Since  mean  time  to  failure  could  be  estimated,  a  table  re¬ 
lating  incentive  to  that  variable  was  prepared.  Also,  a  table  relat¬ 
ing  incentive  to  estimated  reliability  was  prepared.  The  second  table 
showed  the  incentive-to-reliability  relationship  to  be  nearly  linear. 

To  achieve  a  simple  structure,  it  was  decided  to  pay  (0.4378) 
($l,200,000)/9,  or  (rounding  off)  $58,400,  for  each  percent  that  the 
demonstrated  reliability  exceeded  90%:  and  to  deduct  (0.4241) 
($600,000/10,  or  (rounding  off)  $25,450,  for  each  percent  that  the 
demonstrated  reliability  fell  below'  90%.  (In  effect,  the  incentive  struc¬ 
ture  for  reliability  consisted  of  19  steps:  9  payment  steps  and  10  de¬ 
duction  steps .  ) 

(3)  The  contract  duration  incentive  structure  was  set  at 
(0.  021 6) ($1,  200,  000)/ 16,  or  $1620,  incentive  paid  for  each  week  less 
than  52  weeks  that  the  contract  takes  to  complete;  and  (0.  015)($600,  00)/ 
16,  or  $562.  50,  incentive  deducted  for  each  week  more  than  52  weeks 
that  the  contract  takes  to  complete.  (The  incentive  structure  for  con¬ 
tract  duration  also  was  a  step  one:  16  each  for  payments  and  deductions. 
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f.  Having  developed  the  skeleton  of  the  incentive  structure, 
the  team  for  developing  the  incentive  provisions  turned  to  the  ques¬ 
tion  of  how  the  level  of  performance  was  to  be  measured  for  each 
characteristic, 

(1)  The  team  member  from  the  comptroller's  office  had 
no  problem,  since  the  Armed  Services  Procurement  Regulation  and 
precedence  provided  ample  guidance. 

(2)  The  team  member  from  the  reliability  office  realized 
that  his  efforts  to  achieve  maximum  efficiency  would  have  a  large  pay¬ 
off.  Past  experience  with  similar  units  indicated  that  the  mean  times 
to  failure  of  the  units  in  the  field  and  the  mean  times  to  failure  of 
units  tested,  using  Reliability  Laboratory  Test  H,  were  the  same, 
and  that  the  total  test  cost  (including  the  cost  of  performing  the  test, 
the  cost  of  the  components  degraded  by  the  test,  and  the  cost  of  dis¬ 
assembly)  averaged  $260  per  unit  tested  for  Reliability  Laboratory 
Test  H.  Since  this  test  permitted  the  test  units  to  be  returned  to 
as-good-as-new  condition,  a  replacement  test  was  chosen.  A  time- 
terminated  plan  had  to  be  used,  since  only  one  week  (168  hours)  could 
be  allowed  for  running  the  test.  Unable  to  arrive  at  the  best  sample 
size  by  theory,  the  team  member  selected  a  sample  size  of  20  on  the 
basis  of  his  best  judgment  and  recommended  that  the  estimate, 
exp[-(number  of  failures  occurring)/ 160],  be  used  to  determine 
achieved  reliability. 

(3)  The  contract  was  to  be  considered  completed  when 
the  contractor  had  met  all  contractual  requirements  and  had  delivered 
the  required  technical  data  package  in  its  final  form. 

g.  The  incentive  provisions  submitted  for  legal  review  stated: 

"The  cost  of  the  work  covered  by  this  contract,  the  reliability  of 
the  item  developed  under  this  contract,  and  the  contract  duration,  i.e,  , 
award  of  this  contract  to  delivery  of  the  final  draft  of  the  required  tech¬ 
nical  data  package)  shall  be  used  to  adjust  the  fee  for  this  contract. 

For  each  $1000  that  the  cost  of  the  work  covered  by  this  contract  ex¬ 
ceeds  $1 2,  000,  000,  $1 1 2.  20  will  be  deducted  from  the  target  fee.  For 
each  week  that  the  contract  duration  is  less  than  52  weeks,  $1620  will 
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be  added  to  the  target  fee;  and  tor  each  week  that  the  contract  duration 
exceeds  52  weeks,  $562.  50  will  be  deducted  from  the  target  fee.  For 
each  percent  that  the  estimated  item  reliability,  as  determined  by  the 

procedure  given  in  paragraph  _ .2,  below,  exceeds  90%,  $58,400  will 

be  added  to  the  target  fee;  and  for  each  percent  that  the  estimated  item 

reliability,  as  determined  by  the  procedure  given  in  paragraph _ .  2, 

below,  is  less  than  90%,  $25,450  will  be  deducted  from  the  target  fee. 
The  total  fee  paid  shall  be  equal  to  the  target  fee  plus  any  additions 
and  minus  any  deductions  required  by  the  above  provisions. 

" _ .  2.  Procedure  for  Determining  Estimated  Item  Reliability. 

Twenty  units,  prior  to  sealing,  plus  forty  additional  widget  assemblies, 
will  be  furnished  to  the  Army  for  conducting  Reliability  Laboratory 
Test  H  of  KLG  Test  Manual  702-8  at  a  total  cost  of  $724,  000.  This 
cost  will  not  be  used  in  determining  the  total  fee.  The  Army  will  test 
the  twenty  units  for  168  hours,  replacing  each  failure  by  disassem¬ 
bling  the  failing  unit,  inserting  a  new  widget  assembly,  reassembling 
the  unit,  and  continuing  to  test  the  unit  until  its  total  time  under  test 
is  168  hours.  The  number  of  failures  observed,  r,  will  be  inserted 
in  the  expression  e~(r/l60);  the  value  of  this  expression  will  be  rounded 
off  to  the  nearest  percent  and  this  percentage  used  as  the  estimated 
reliability.  " 
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APPENDIX  D 

RELIABILITY  PREDICTION  AND  APPORTIONMENT  PROCEDURES 
Section  I.  INTRODUCTION 

D-l.  General.  The  contents  of  this  appendix  are  intended  to  pro¬ 
vide  some  analysis  methodology  which  may  be  used  to  implement  the 
discussions  in  chapter  IV.  Since  both  prediction  and  apportionment 
are  dependent  upon  reliability  models,  several  basic  models  are 
formulated  and  illustrated  by  example.  In  addition,  some  specific 
prediction  and  apportionment  procedures  are  included. 

Section  Q.  MATHEMATICAL  MODELS 

D-2.  General.  The  reliability  mathematical  model  is  a  set  of  func¬ 
tions  depicting  the  reliability  characteristics  of  the  system.  The 
basic  laws  of  probability  will  be  utilized  in  this  appendix  to  describe 
the  reliability  models  associated  with  certain  basic  system  functional 
configurations.  These  models  may  be  combined  to  form  a  model  for 
more  complex  configuration.  Discussion  is  confined  to  models  for 
which  independence  of  all  components  and/or  subsystems  is  assumed. 
However,  the  models  may  be  modified  if  dependence  between  sub¬ 
systems  is  known. 

D-3.  Series  model,  a.  When  a  group  of  components  or  subsystems 
must  function  properly  for  the  system  to  succeed,  they  are  said  to 
function  in  series.  A  system  consisting  of  a  series  arrangement  of 
n  components  is  illustrated  in  block  diagram  form  in  figure  D-l. 


Figure  D-l 

Block  Diagram  of  Series  Components 
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b.  In  order  to  state  the  reliability  model,  the  following 
symbols  will  be  used: 


R„  =  syst  cm  reliability  or  probability  that  the 
system  will  function  properly. 

=  reliability  of  the  i^  component  (or  subsystem)  or 
probability  that  it  will  function  properly. 


Qs  =  1-RS  =  unreliability  ol  the  system. 

=  l~Ri  -  unreliability  of  the  it^1  component  (or  subsytem). 


Using  the  multiplication  law  of  probability  describing  the  intersection 
of  n  events. 


Rs  ,RlR2...Rn 


n 

n 

i=  1 


R. 

l 


If  all  subsystems  have  equal  reliability  R, 


Rs  =  Rn 


c.  As  an  example  of  this  model,  consider  a  tracked  vehicle. 

The  two  tracks  function  as  a  series  because  the  vehicle's  locomotion  is 
unsatisfactory  if  either  track  breaks.  Historical  information  indicates 
that  each  track  has  a  probability  of  0.  95  of  surviving  a  specific  mission. 
Find  the  reliability  of  the  two  tracks  as  a  system. 


(1)  Figure  D-2  is  a  block  diagram  representing  this  system 
and  showing  the  subsystem  reliabilities  for  the  specific  mission. 


Rl  -  0.  95  R2  =  0.  95 


1 

2 

Figure  D-2 

Block  Diagram  ~  Series  Example 
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(2)  The  resultant  system  reliability  i& 

Rs  »  Rj  R2  =  (0  .  95)  (0.  95)  =  0.  9025 

D-4.  Parallel  model,  a.  System  or  subsystem  reliability  can 
sometimes  be  increased  by  including  redundant  components  so 
that  success  is  achieved  as  long  as  at  least  one  is  operating  satis¬ 
factorily.  First  we  shall  consider  active  redundancy  where  all  the 
redundant  components  are  simultaneously  subjected  to  operation 
unless  they  have  failed.  Such  components  are  sa.  '  to  be  in  parallel. 
A  parallel  system  of  n  corroonents  (or  subsystems)  is  illustrated  in 
block  diagram  form  in  fi  e  D-  3. 


Figure  D-3 

Block  Diagram  of  Parallel  Components 

b.  Since  system  failure  occurs  only  when  ail  subsystems  fail, 
the  reliability  model  can  best  be  approached  by  finding  system  unreli¬ 
ability  as  an  intersection  of  component  unreliabilities.  Then  the  sys¬ 
tem  reliability  is  the  complement  of  the  system  unreliability. 

Qg  -  Q1Q2Q3  •**  Qn  ”  n  Qi  =  n  (i-Rj)  -  i*r6 
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Rg  =  l*Qg  -  (1-Rj) 

If  the  n  components  are  identical,  defining  component  reliability  as 
R,  the  above  mode)  becomes 

Rs  -  1  -  (1-R)n 

c.  An  example  of  this  model  might  be  a  volley  of  4  artillery 
shells  fired  at  a  specified  target.  Each  shell  has  a  probability  of  0.  3 
of  destroying  the  target.  Find  the  probability  that  the  target  will  be 
destroyed  by  the  volley. 

(1)  Figure  D-4  shows  a  block  diagram  representing  the 
parallel  (redundant)  function  of  the  four  rounds. 


Figure  D-4 

Block  Diagram  -  Parallel  Example 
(2)  Since  the  4  shells  are  identical,  the  reliability  of  the 

volley  is 

Rg  =  1-(1-R)M  =  l-{l-0.  3)4  =  0.7599 

D-5.  Partial  redundancy  model,  a.  In  the  previous  redundancy 
model,  the  system  succeeded  if  at  least  one  of  the  parallel  elements 
is  successful.  There  may  be  cases  where  at  least  k  out  of  n 
identical  elements  must  be  successful.  Such  a  configuration  is  some¬ 
times  called  partial  redundancy.  The  binomial  distribution  may  be 
used  to  develop  the  reliability  model  if  all  elements  are  identical.  The 
general  block  diagram  is  shown  in  figure  D-5. 
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at  least  k 
must  function 

Figure  D- 5 

Block  Diagram  -  Partial  Redundancy 


b.  If  the  reliability  of  each  element  is  R,  the  model  is 
A 


= 


x  =  k 


n 

Q  Rx(l-R)n'x  =  '  - 2. ' - 

\xy  x !  (n-x) ! 

x=k 


Rx(l-R) 


n-x 


c.  Suppose  an  eight  cylinder  engine  can  operate  successfully 
if  at  least  seven  of  the  eight  spark  plugs  are  functioning  properly.  A 
single  plug  has  a  reliability  of  0.  95  for  a  certain  mission.  Find  the 
reliability  of  the  partial  redundancy  system  of  eight  plugs  for  this 
mission. 

(1)  Figure  D-fc  shows  this  system  as  a  block  diagram. 


( 


f  •* 
a 
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Figure  D-6 

Block  Diagram  -  Partial  Redundancy  Example 


(2)  The  system  reliability,  probability  that  at  least  7  o£ 

8  plugs  will  function  properly,  is 

£  ^  \ 

Rs  =  j'(.95)x  !,05)8'x  -•  0.943 

D-6.  Standby  redundancy  models. 

a.  Definition.  The  foregoing  models  have  had  to  do  with 
active  redundancy,  i.e.,  all  elements  are  operating.  In  some 
instances,  redundancy  may  take  the  form  of  elements  standing  by 
to  take  over  when  the  primary  element  fails.  Standby  redundancy 
arrangements  require  failure  -  sensing  and  switching  devices  which 
contribute  to  system  unreliability. 

b.  Exponential  model.  Consider  n  +  1  identical  elements  where 
only  one  is  functioning  when  the  system  is  initiated  and  the  remaining  n 
elements  are  standing  by  until  preceding  elements  fail.  Assuming  a 
perfect  sensory  and  switching  procedure,  system  reliability  is  the  pro¬ 
bability  of  n  or  less  failed  elements  within  the  prescribed  mission  time. 
Determination  of  this  probability  depends  upon  the  distribution  of  failure 
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times.  The  model  which  follows  depends  upon  exponential  failure 
times. 


Rs(x)  = 


exp^-Ax) 
k  1 


'  1  +  a  x  +  ( -x) _  +.  .  .  +  (^x)  exp(-Ax) 

2 !  n!  J 


where  x  is  a  time  variable 


A  is  the  failure  rate  of  the  individual  elements. 


c.  General  model 

(1)  Consider  a  system  composed  of  n  +  1  elements  where 

n  are  standing  by  and  ail  elements  are  not  identical  and  may  even  have 
different  failure  time  density  functions.  The  general  model  for  system 
reliability,  assuming  independence  of  the  elements  and  a  perfect 
switching  procedure,  is  as  follows: 

(2)  System  failure  occurs  only  when  the  n  +  1  elements  fail. 
The  system  failure  time  density  function,  i.  e.  ,  the  probability  density 
function  for  the  time  to  failure  (n+1)  is: 


*0=°  Vr° 


•  tj=0 


fl  f2  (Vh)  ••• 


fn+l  dtl  dt2  ‘  ‘  dtn 

where  t^  is  the  time  from  mission  beginning  till  the  i1^  element  will 
fail,  x  is  the  variable  indicating  system  failure  time  ;  i.  e.  ,  (n  +  l)th 
element  failure;  and  fj(x)  is  the  probability  density  function  of  the  i4*1 
element  failure  times.  Then  system  reliability  is 

Rs(x)  =  (  ffi(t)dt 


(3)  As  a  special  case,  consider  a  two-element  standby 
Bystem;  i.e.  ,  one  primary  and  one  standby  element;  where  each  ele¬ 
ment  failure  time  distributi  n  is  exponential  but  with  different  failure 
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rates.  The  density  functions  are 


(x)=  X  i  cxp(-  X  ix) 


and 


f2  (x)  «=  X2exp(-X  x) 


r  X 

f  (x)  *  \  X  x  X2  {  exp(- X  jtj)  }  {  exp[ -X2(x-t1)  ]}  dtj 


'V° 


X  j  X^  exp(-  X2x)  -q  CX^  ^  X2-X  ]  dtj 


X,  X 


1  A2 


X  -X 
2  1 


[  exp  {-  X  jx)  -  exp  {-X  2x)  ] 


Then  system  reliability  becomes 
n  X  X-> 

Rs  (x)  =  \  ^  [exp  (- Xjt)  -  exp  (-x2t)]  dt 

Jx  X  2  -X  i 

X2exp(-X^x)  ~Xj  exp  ( -  X  2x) 


X2  .  Xt 


(4)  The  density  function  for  a  three  element  standby  system 
(assuming  exponential  distributions)  becomes 

1,(x)=  kJ,,..  <«*<-*,  «i)> 

{exp[-X2(t2-t1)]}  {exp  {  -X3(x-t2)]  }dtj  dt2 
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(5)  The  same  method  can  be  used  to  expand  to  any  number 
of  elements  where  the  appropriate  density  function  is  used  for  each. 

d.  Imperfect  switching  model. 

(1)  Preceding  inactive  redundancy  models  have  assumed 

a  perfect  switching  procedure.  In  practice,  however,  the  probability 
of  switch  failure  has  a  significant  affect  upon  system  reliability.  Some 
genera]  rules  for  building  switch  reliability  into  the  models  will  be 
considered.  (For  limitations,  see  (12)  below.) 

(2)  Two  modes  of  failure  which  are  often  associated  with 
switching  mechanisms  are:  the  switch  may  fail  to  operate  when  it 
should,  and  the  switch  may  operate  prematurely.  The  model  for  a 
two-element  standby  redundancy  is  shown  in  block  diagram  form  in 
figure  D-7. 


Block  Diagram  -  Two-Element  Standby  Redundancy 

(3)  The  diagram  indicates  that  whenever  element  1  fails, 
the  switch  activates  the  standby  element  2.  The  symbols  tc  be  U9ed 
to  develop  a  model  are: 

Pj  =  probability  that  the  i^*1  elemeni  succeeds 
qi  =  i-Pi 

riw  =  probability  that  the  switch  will  fail  to  operate 
when  it  should 
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Pw  =  l-<3w 

q*  =  probability  that  the  switch  will  operate 
prematurely 

P  w  w 

(4)  The  system  has  three  possible  element  states  which 
could  lead  to  system  failure: 

(a)  Element  1  succeeds,  switch  operates  prematurely 
and  element  2  fails. 

(b)  Element  1  fails,  switch  fails  to  operate. 

(c)  Element  1  fails,  properly  switches  to  2  and  2  fails. 

Then  system  unreliability  becomes 

Q8  =  Pl<l'w<l2  L  <ll<lw  +  cUPwtl2 

and  system  reliability  is 

R8  =  1-(Piq'w<l2  +  ^w  +  ^lPw^) 

(5)  To  exemplify  the  model,  consider  a  two-element 
standby  redundant  system  where  the  identical  elements  each  have  a 
0.9  probability  of  successfully  completing  its  mission.  The  switching 
mechanism  is  such  that  there  is  a  0,05  probability  of  premature 
switching  and  0.  01  probability  of  failing  to  switch  when  a  switch  should 
occur.  Find  the  system  reliability. 

(6)  The  resulting  system  reliability  is  shown  below. 

Pi  =  P2  =  0. 9 

qi  =  q2  =  0.1 

qw  =  0.  01 

q'w  =  0.05 
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Rg  =  1  -  [  0.  9(0.  05)(0. 1)  +  0.1(0.01)  +  0. 1(0.  99)(0. 1)1  = 

1-0.  0155  =  0.  9845 

(7)  The  model  for  a  three -element  standby  redundant 
system  is  more  complex  and  is  shown  below.  The  switching  of  ele¬ 
ments  into  operating  status  can  take  place  only  in  ascending  numer¬ 
ical  order  shown  in  figure  D-8. 


Figure  D-8 

Block  Diagram  -  Three  Element  Standby  Redundancy 
(8)  The  symbols  to  be  used  are: 

Pi  =  I'^i  =  probability  that  the  itn  element  will 
succeed. 

Pwl  =l-qw^  =  probability  that  the  mechanism  will 

switch  to  element  2  if  element  1  fails. 

pw2  =  i~<lw2  ~  probability  that  the  mechanism  will 

switch  to  element  3  if  element  2  fails. 


^  wl  *'P'wl 


=  probability  that,  given  element  1  is 
operating  properly,  the  mechanism 
will  wrongly  switch  to  element  2. 


AMCP  70?. -3 

q'w2=  1-p'  j  =  probability  that,  given  element  2  is 
operating  properly,  the  mechanism 
will  wrongly  switch  to  element  3. 

(9)  System  failure  ca  t  happen  only  in  the  following  seven 
element  states. 

(a)  Element  1  succeed,  wrongly  switch  to  2,  2  succeed, 
wrongly  switch  to  3  and  3  fail 

(b)  Element  1  succeed,  wrongly  switch  to  2,  2  fail, 
properly  switch  to  3  and  3  fail. 

(c)  Element  1  succeed,  wrongly  switch  to  2,  2  fail 
and  no  switch  to  3. 

(d)  Element  1  fail  and  no  switch  to  2. 

(e)  Element  1  fail,  a  proper  switch  to  2,  2  fail  and 

no  switch  to  3. 

(f)  Element  1  fail,  a  proper  switch  to  2,  2  succeed, 
wrongly  switch  to  3  and  3  fail. 

(g)  Element  1  fail,  a  proper  switch  to  2,  2  fail,  a 
proper  switch  to  3  and  3  fail. 

(10)  Then  system  unreliability  is 

Qs  =  Piq'wlP2<l'w2q3  +  Pl(l'wl{l2Pw2q3  +  Pl^wl^S^  + 

qiqwl  +  qlPwiq2qw2  +  qlPwlP2q,w2q3  +  qlPwlq2Pw2q3 

and 


R  =  1-Q 

S  3 

(li)  The  method  may  be  extended  to  standby  redundant 
systems  of  more  than  three  elements.  Other  failure  modes  may  also 
be  added,  e.g.,  switch  contact  failure  is  sometimes  encountered. 
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(12)  The  standby  redundancy  models,  with  imperfect 
switching  mechanisms,  shown  above,  have  considered  success  or 
failure  of  an  element  as  being  independent  of  time,  i.  e.  ,  the  re¬ 
maining  mission  time  when  an  element  is  activated  does  not  affect 
the  probability  of  its  success.  The  models  may  be  further  refined 
by  considering  failure  distributions  of  the  elements  as  well  as  the 
incorrect  switch  time  distribution.  Development  of  such  models 
would  be  similar  to  the  method  used  for  redundant  models  with  perfect 
switching  mechanisms.  Such  models,  however,  are  not  included  here¬ 
in. 


D - 7 .  Conditional  probability  and  the  reliability  model, 
a.  General. 

(1)  There  exist  configurations  of  subsystems  which  are 
not  series,  parallel,  or  standby  as  previously  defined.  Conditional 
probability  may  be  used  to  facilitate  the  modeling  of  such  configura¬ 
tions.  A  useful  theorem  is  stated: 

m 

P(A)  =  2  P(A/Bl)P(Bi) 

1=1 


where  the  IT  are  mutually  exclusive  events  such  that 
m 

SP(Bl)  =  1 

i-l 

A  special  case  of  this  theorem  where  m  =  2  is  sometimes  useful  for 
reliability  modeling 

P(A)  =  P(A/B1)  P(B1)  +  P(A/B2)  P(B2) 

where  and  B^  are  mutually  exclusive  and  exhaustive  events. 

(2)  For  example,  consider  a  configuration  as  shown  by 
figure  D-9. 
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Figure  D-9 

Block  Diagram  -  Conditional  Probability  illustration 

The  conditions  lor  a  successful  operation  of  the  system  are:  proper 
functioning  of  subsystems  l  and  Z,  >  and  4,  or  5  anil  4.  The  model  tor 
this  configuration  may  be  stated  in  terms  of  conditional  probability  as 

5(S)  •-  P(S/SJP(SJ  4  P(S/S  IPfS-l 
-  0  '  - 

where  Rs  =  system  reliability 

P(S/Sc,l  =  system  reliability  given  subsystem  5  does  not  fan 
PfS/oj)  =  system  reliability  given  subsystem  5  fails 
PiS.-)  ;  reliability  ol  subsystem  5 
P(S^)  =  unreliability  of  subsystem  3 

b.  Example. 

(1)  To  illustrate  the  use  of  conditional  probability,  consider 
an  anti-aircraft  s /stern  with  primary  subsystems  of  detection  (D), 
tracking  (T),  and  firing  fF).  A  backup  detection  subsystem  (BD)  is 
to  be  used  only  when  D  fails.  The  moth  id  lor  determining  when  D 
fails  and  switching  the  function  to  BD  is  referred  to  as  subsystem  M 
and  has  only  one  mode  oi  failure,  that  ol  failing  to  swi'ch  to  BD  if  D 
fails.  Figure  D-10  shows  a  block  diagram. 
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Figure  D-10 

Block  Diagram  -  Conditional  Probability  Example 


(2)  First  consider  D  to  be  operative.  Since  M  cannot  fail 
for  this  mode  of  operation  and  D  is  successful,  the  system  reduces  to 
the  diagram  in  figure  D -  1  1 ,  and  the  conditional  system  reliability  be¬ 
comes  p(S/Sj-j)  r  P(Sj)P(Sp). 


F igure  D-ll 

Block  Diagram  -  Primary  Detection  Suosystem  Operative 

(3)  Next  consider  D  to  be  inoperative.  The  system  reduces 
to  the  diagram  in  figure  D-1Z  and  the  conditional  system  reliability  be¬ 
comes 


PfS/SD)  =  P(Sm)P(Sbd)P(St)P(Sf) 


F  i  g  u  r  e  D  - 1 2 

Block  Diagram  -  Primary  Detection  System  Inoperative 
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(4)  The  unconditional  system  reliability  then  is 

P(S>  =  P(St)P(Sf)P(Sd)  +  P(Sm)P(Sbd)P(St)P(Sf)P(Sd) 

c.  Conditional  probability  may  be  applied  to  a  variety  of  com¬ 
ponent  configurations.  Complex  combinations  of  series  and  parallel 
models  are  often  more  easily  analyzed  by  applying  the  conditional 
probability  theorem  one  or  more  times,  considering  a  key  item  first 
as  operative  and  then  as  inoperative. 

Section  III.  RELIABILITY  PREDICTION 

D-8.  Gene ral.  Reliability  prediction  is  the  use  of  the  reliability 
model  to  combine  reliability  information  concerning  components  and 
subsystems  to  determine  a  prediction  of  system  reliability.  The  key 
activities  associated  with  reliability  prediction  are  discussed  in 
chapter  4. 

D-9.  Mixed  model  example,  a.  Most  practical  systems  will 
not  fit  any  single  model  of  section  II,  but  rather  are  represented 
by  combinations  and/or  variations  of  these  models.  To  show  this, 
the  following  paragraphs  contain  an  example  of  reliability  prediction 
for  a  mixed  system. 

b.  An  automobile  is  to  be  used  for  a  500  mile  trip  and  the 
reliability  is  to  be  predicted  for  this  trip.  Reliability  information 

is  available  concerning  automobile  subsystems:  tires,  lighting  group, 
spark  plugs,  brake  system  and  all  other  subsystems  collectively. 

c.  The  tire  subsystem  (subsystem  T)  ir  comprised  of  5  tires, 
four  originals  and  a  spare,  where  the  spare  is  a  standby  to  r  lace  the 
first,  if  any  blowout.  The  trip  length  is  such  that  wearcut  does  not 
occur,  but  blowouts  may  occur  because  of  chance  random  stresses  en¬ 
countered.  Past  information  indicates  miles  between  blowouts  to  be 
exponentially  distributed  with  failure  rate  of  0.  0001  blowouts  per  mile. 
Figure  D - 1 3  shows  block  diagrams  for  the  four  potential  configurations 
which  mav  occur.  Tl,  T2,  T3  and  T4  are  the  original  tires  and  T5  is 
the  spare. 
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Figure  D-13 

Block  Diagram  -  Tire  Subsystem 


(1)  Since  only  one  replacement  tire  is  available,  the 
reliability  of  subsystem  T  for  a  500  mile  trip  is  merely  the  probabil¬ 
ity  of  not  more  than  one  failure  in  2000  miles  of  tire  use,  i.e. , 

1  k 

H-p  =  E  ■  —  exp(-Xx) 

k=o  k ! 

where  X  -  0.0001  blowouts  per  mile  and 
x  =  2000  tire-miles  mission. 

(2)  Then  the  numerical  reliability  of  subsystem  T  is 

R-t  -L°-.2J-  exp  (-0.  2)  =  0.  9825 
T  k=o  k | 
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d.  The  subsystem  of  spark  plugs  (subsystem  P)  is  comprised 
of  eight  plugs.  Although  undesirable,  the  automobile  can  continue  the 
trip  with  only  7  operating  spark  plugs.  Since  a  500  mile  trip  will  not 
cause  the  plugs  to  wear  out,  the  failure  distribution  for  each  plug  is 
exponential  with  failure  rate  of  0.00003  failures  per  mile  during  the 
trip.  Figure  D-14  is  a  block  diagram  for  this  partially  redundant  sub¬ 
system. 
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Figure  D-14 

Block  Diagram  -  Spark  Plug  Subsystem 

(1)  The  reliability  of  each  individual  spark  plug  for  the 
500  mile  trip  is 

exp(-Ax)  =  exp  (-0.  015)  =  0.  9851 
where  \  =  0.  00003  failures  per  mile  and 
x  =  500  miles 
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(2)  The  numerical  reliability  of  subsystem  P  is 

R  =  S  /8\o.  0149)k  (0.  9851)8*k  =  0.9937 
P  k  =  o\kJ 

e.  The  braking  subsystem  (subsystem  B)  i3  comprised  of 
two  independent  and  identical  brake  units  functioning  in  parallel. 
Past  information  indicates  that  such  a  unit  is  0.  99  reliable  for  a  500 
mile  trip.  Figure  D-15  is  a  block  diagram  for  this  redundant  sub¬ 
system. 


Figure  D-15 

Block  Diagram  -  Braking  Subsystem 
Then  the  reliability  of  subsystem  B  is 
Rfi  =  l-(l-0.  99)2  =  0.  9999 

f.  The  lighting  subsystem  (subsystem  L)  considers  the  head¬ 
lights  and  rear  lights.  For  safety  during  nondaylight  driving,  both 
headlights  and  at  least  one  of  the  two  rear  lights  must  function  properly. 
For  the  500  mile  trip,  an  average  of  three  hours  of  nondaylight  driving 
can  be  expected.  Failures  occur  (for  this  typical  trip)  exponentially, 
with  a  failure  rate  of  0.005  failures  per  hour  for  a  headlight  and  0,004 
failures  per  hour  for  a  rear  light.  Figure  D-l6  shows  the  block  dia¬ 
gram  for  subsystem  I,. 


Figure  D-16 

Block  Diagram  -  Lighting  Subs'  skm 
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(1)  The  reliability  of  each  headlight  fcr  a  3  hour  mission 

is 

R  =  exp  [  -3(0.  005)1  =  exp  (-.  015)  -  0.  9851 
IwH 

The  reliability  of  each  rear  light  for  a  3  hour  mission 

is 


R  ~  exp  1-3(0.  003)]=  exp  (-0.  009)  =  0.  9910 
LR 

(2)  Then  the  reliability  of  subsystem  L  is  found  as  follows: 

(a)  Define  subsystem  A  as  the  parallel  confip uration 
of  R1  and  R2.  Then 

Ra  =  1-(1-F.  1Z  =  1- (1- 0.  9910)2  =  0.  999919 
A  LR 

(b)  Treating  HI,  H2  and  A  as  subsystems  in  series, 

RL  =  RLHRDHRA  =  9851)2  <°*  999919)  r-  0.9/03 

g.  All  other  functional  subsystems  of  the  vehicle  are  grouped 
as  a  single  subsystem  denoted  by  "other"  (subsystem  O).  Data  from 
past  records  indicate  the  reliability  of  this  subsystem  for  the  given 
trip  to  be 


=  0.9990 

h.  The  entire  system  is  represented  by  a  functional  series  of 
subsystems  T,  P,  B,  L<  and  O  as  shown  by  the  block  diagram  in  figure 
D-17. 


Figure  D-17 

Block  Diagram  -  Vehicle  System 
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Then  the  system  reliability  may  be  predicted  a3 

R  =R„L-  RnRtR 
S  T  P  B  L  O 

=  (0.9825)(0.9937)(0.9999)(0.  9703)(0.9990)  =  0.9463 

Section  IV.  RELIABILITY  APPORTIONMENT 

D-10.  General.  Reliability  apportionment  utilizes  the  reliability  model 
to  assign  combinations  of  compatible  goals  among  subsystems  such  that 
subjection  of  the  model  to  these  subsystem  goals  will  yield  the  system 
goal.  Discussion  of  apportionment  in  this  appendix  will  be  confined  to 
some  specific  techniques  of  apportionment,  two  of  which  approach 
apportionment  with  minimum  expenditure  of  effort. 

D-ll.  Equal  apportionment  technique.  a.  The  equal  apportionment 
technique  assumes  a  series  of  n  subsystems  each  of  which  is  to  be  as¬ 
signed  the  same  reliability  goal.  A  prime  weakness  of  the  method  is 
that  the  subsystem  goals  are  net  assigned  in  accordance  with  the  degree 
of  difficulty  associated  with  achievement  of  these  goals.  For  this  tech¬ 
nique,  the  model  is 

_  *  n  # 

R  =  n  r  ■ 

i=  1 


#  ❖  1  /  n 

R  i  =  (R  )  for  i  =  1,  2 . n 

Where  R  is  the  required  system  reliability  and 


R  j  is  reliability  requirement  apportioned  to  subsystem  i. 

b.  To  exemplify  this  technique,  consider  a  proposed  commun¬ 
ication  system  which  consists  of  3  subsystems  (transmitter,  receiver 
and  coder)  each  of  which  must  function  if  the  system  is  to  function. 
Each  of  these  subsystems  is  to  be  developed  independently.  Assuming 
each  to  be  equally  expensive  to  develop,  what  reliability  requirement 
should  be  assigned  to  each  subsystem  in  order  to  meet  a  system  re¬ 
quirement  of  0.  729. 
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c.  The  apportioned  subsystem  requirements  are  found  ?s 

R*x  =  r*r  =  R*c  =  (R*)1/n  -  (0.729)1/3  *  0.90 

Then  a  reliability  requirement  of  0.  90  should  be  assigned 
to  each  subsystem. 

D-12.  AGREE  apportionment  technique,  a.  This  technique  takes  into 
consideration  both  the  complexity  and  importance  of  each  subsystem 
for  electronic  systems.  It  assumes  a  series  of  k  subsystems  each  with 
exponential  failure  distributions.  Then  the  minimum  acceptable  mean 
life  of  the  ic^  subsystem  is  defined  as 


Nwtti 


0 


nj  [-In  R*(t)] 

and  the  corresponding  i**1  subsystem  reliability  requirement  becomes 
Ri*(ti)  = 


where 

i  -  1,2,  3,  . .  .  ,  k 

t  =  required  mission  time  of  t'  c  system 

t^  =  required  mission  time  of  the  i**1  subsystem 

w.  =  importance  factor  expressed  as  the  probability  that  failure 
of  the  i  ^  subsystem  will  result  in  system  failure. 

*4  =  number  of  modules  in  the  i**1  subsystem 
k 

N  =  2  nj  =  total  number  of  modules  in  the  system 

i=l 

R  (t)  =  the  required  system  reliability  for  system  mission  time 

Ri  (*i)  ~  the  reliability  apportioned  to  the  iln  subsystem  for  its 
mission  time 

9.  =  apportioned  mean  time  to  failure  for  the  irh  subsystem 


D-22 


AMCP  702-  3 


b.  A  cone  jot  of  module  is  used  in  this  technique  for 
three  purposes;  (1)  so  that  the  relative  complexity  inherently  re¬ 
quired  can  be  taken  into  account;  (2)  so  that  the  minimum  acceptable 
reliability  figures  will  not  be  grossly  inconsistent;  and  (3)  so  that 
reliability  requirements  will  be  dynamic  and  state  of  art  changes 
can  be  incorporated  as  they  occur.  A  module  is  designated  as  the 
basic  electronic  building  block  and  is  considered  to  be  a  group  of 
electronic  parts.  This  is  a  fictitious  way  of  partitioning  an  elec¬ 
tronic  system  for  reliability  purposes.  For  systems  involving 
electron  tubes,  it  has  been  found  that  for  one  tube  there  are  approxi¬ 
mately  fifteen  additional  electronic  parts  --  this  is  considered  to  be 
a  module.  Thus,  the  number  of  modules  for  an  equipment  is  defined 
as  the  number  of  electron  tubes. 

c.  To  illustrate  the  AGREE  apportionment  method,  consider 
a  fictitious  system  composed  of  four  subsystems.  The  system  has 

a  mission  time  of  4  hours  and  required  reliability  of  0.  9.  Figure  D-18 
shows  the  number  of  modules,  importance  factor  and  mission  time  for 
each  subsystem. 


Subsystem 

(i) 

No.  Modules 
(•^i) 

Importance 

Factor 

(w£) 

Mission 

Time 

(t,:) 

1 

20 

0.7 

4 

2 

30 

0.  5 

4 

3 

200 

0,  8 

4 

4 

50 

0.  2 

4 

. 

N  =  300 

I 


Figure  D-18 

d  The  apportionment  to  each  subsystem  is  found  as  follows: 
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NWjtj 

i  n^  [-In  R*(t)] 

and 

z'  -t:  \ 

R*  (ti)  =  exp.  i— 
i  \  6  i 

* 

where  R  (4)  =  0.  90 


e  =  = . §±g_  =  39s  hoUrs 

1  20(0.1054)  2.103 

Rr  (4)  =  exp  (-4/393)  =  exp  (-0.  01)  =  0.  990 

1 

,  =  -10.0-CL 5)111  _6£0_  -  189  hours 

02  30(0.1054)  3.162 

R  (4)  =  exp  (-4/189)  =  exp  (-0.021)  -  0.979 


=  300(0..  8Jj4j  .960.  =  45  hours 

3  200(0.1054)  21.08 

R*3  (4)  =  exp  (-4/45)  =  exp  (-0.  089)  =  0.  911 

g  =  .300(0.  2jj42_  _  ._24?__  _  45  hours 

4  50(0.1054)  5.27 

R* 4  (4)  =  exp  (-4/45)  -  exp  (-0.089)  =  0.911 


D-13.  The  ARINC  apportionment  technique,  a.  This  method  assumes 
series  subsystems  with  constant  failure  rates  such  that  any  subsystem 
failure  causes  system  failure  and  that  subsystem  mission  time  is  equal 
to  system  mission  time. 
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b.  The  apportionment  technique  requires  expression  of 
reliability  requirements  in  terms  of  failure  rate.  The  following  steps 
apply: 

* 

(1)  Tne  objective  is  to  choose  X  i  such  that 

n  *  # 

.  -  X  i  <  X 
i=l  — 

whe  re 

X  i  is  the  failure  rate  allocated  to  subsystem  i; 

* 

X  is  the  required  system  failure  rate. 

(2)  Determine  the  subsystem  failure  rates  (X^)  from  past 
observation  or  estimation. 

(3)  Assign  a  weighting  factor  (w^)  to  each  subsystem 
according  to  the  failure  rates  determined  in  step  2. 


X  . 
1 


(4)  Allocate  subsystem  failure  rate  requirements 

X  *  =  w  X  * 
i  1 

c.  To  illustrate  this  method,  consider  an  antiaircraft  system 
composed  of  three  subsystems  (detection  equipment,  tracking  equip¬ 
ment  and  firing  equipment)  with  predicted  failure  rates  of  X  ^  =  0.  003, 

X  2  =  0.  001  and  Xj  =  0.004  failures  per  hour  respectively.  The  system 
has  a  mission  time  of  20  hours  and  0.90  reliability  is  required.  Find 
the  subsystem  requirements. 

d.  The  apportioned  failure  rates  and  reliability  goals  are  found 
as  follows: 

(1)  R*  (20)  =  exp  [  -  X*(20)  1  =0.90 

Tnen 

* 

X  =  0.  005  failures  per  hour. 
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(2) 

kl  ~ 

0.  003,  X 

2  =  0.  001,  X  3  - 

0.  00* 

(3) 

W1  = 

0.  003 

=  0. 375 

0. 003  + 

0.  001  +  0.  004 

w2  = 

0.  001 

=  0. 125 

0. 003  + 

0.  001  +  0.  004 

0.  004 

=  0.  5 

W  *— 

3 

0.  003  + 

0.  001  +  0.  004 

(4)  \*  =  0.  375  (0.  005)  =  0.  001875 

\z  -  0. 125(0.  005)  =  0.  000625 

* 

*3  •  0.  5  (0.  005)  =  0.  0025 

(5)  The  corresponding  apportioned  subsystem  reliability 
requirements  are 

1^(20)  =  exp  [  -20(.  001875)1  =  0.  96 
R%(20)  =  exp  [  -20(.  000625)]  =  0.99 
R*3(20)  -  exp  [  -20(.  0025)  1  =  0.95 


D-14.  Minimization  of  effort  algorithm.  a.  This  apportionment 
technique  considers  minimization  of  total  effort  expended  to  me  it  the 
system  reliability  requirements.  A  system  is  considered  where  n 
subsystems  are  arranged  in  series. 


b.  Let  Rj,  R2,  .  .  .  ,  R^  denote  subsystem  reliabilities  and  the 
system  reliability  R  would  be  given  by 


R 


n 

JlRi 
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* 

c.  Let  P.  be  the  required  reliability  of  the  system,  where 

R  >  R.  It  is  then  required  to  increase  at  least  one  of  the  values  of 
the  Rj  to  the  point  that  the  required  reliability  R*  will  be  met.  To 
accomplish  such  an  increase  takes  a  certain  effort,  which  is  to  be 
alloted  in  some  way  among  the  subsystems.  The  amount  of  effort 
would  be  some  function  of  number  of  tests,  amount  of  engineering 
manpower  applied  to  the  task,  etc.  . 

d.  The  algorithm  assumes  that  each  subsystem  has  associated 
with  it  the  same  effort  function  G(Rit  R  <)  which  measures  the  amount 

t  .  ^  4.L 

of  efforh  needed  to  increase  the  reliability  of  the  iln  subsystem  from 
Rj  to  R  j. 

e.  The  assumptions  on  G(x,y)  where  y  >x  are: 

(1)  G(x,y)>0 

(2)  G(x,  y)  is  nondecreasing  in  y  for  fixed  x  and  non¬ 
increasing  in  x  for  fixed  y.  That  is 

G(x,  v)  '  G(x,  y  +  A  y)  and 

G(x,  y)  5.  G(x  +  A  x,  y) 

(3)  G(x,  y)  +  G(y,  z)  =  G(x,  z)  where  x  <  y  <  z. 

(4)  G(0,x)  has  a  derivative  h(x)  such  that  xh(x)  is  strictly 
increasing  in  (0  <  x  <  1). 

$ 

f.  The  problem  then  is  to  determine  such  that 

n  * 

^  G(R  ,  Rr  ) 

, -1  -  *  ' 

is  minimized  subject  to  the  condition 

n  *  # 

n  =  R 
i=l 
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in  o:  der  to  achieve;  system  success.  The  system  reliability  re¬ 
quirement  has  been  set  at  0.70.  We  have,  predicted  subsystem  reli¬ 
abilities  as  RA  ”  0.  90,  Rg  ‘  0.  80,  and  P^  -  0.  85,  How  should  we 
apportion  reliability  to  the  subsystems  in  order  that  total  effort  be 
minimized  and  that  the  system  reliability  requirement  be  satisfied? 
Assume  identical  effort  functions  for  the  three  subsystem.,. 

k.  The  resulting  minimum  effort  apportionment  goals  are 
found  as  follows: 


order: 


(1)  Arrange  subsystem  reliability  values  in  ascending 
RT  =  Rfi  =  0.  80;  R2  =  Rc  =  n.  85  and  Rg  =  RA  =  °-  90 

(2)  Determine  KQ,  the  maximum  value  of  j,  such  that 


1 


1/j 


/  n+1  \ 

HR  ;  ' 
,i=j+r 


=  r . 
J 


(3)  When  j  =  1, 

R,  =  0.  80  <  r,  =  ''  - - 

1  1  .R2R^.(1.00) 

(4)  When  j  =  2, 

R2  --  0.  85  <  r 2 


0.  70 


1  I 


0.  70 


(0.  85)f0.  90)(1.  00)  .  0.765. 


0.  70 


.11/2  /ZV/2  =-l  ,o.882 

(0.  90)(1.  00)  I  \9  . ’  3 


(5)  When  i  =  3, 

R  =  a.  90  >  r,  =r - - 1!/?  =  (0.  70)1/3  =  .  888 

3  3  1.00 


(6)  Since  Rj<  r^,  R->  <  r2>  but  R^  >  r^,  then  KQ  =  2  because 
2  is  the  largest  subscript  j  such  that  R^  <  r^.  Thus, 

R*  =  |  °-  70  11/2  =  0.882 
0.90  1 


915 
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which  means  tnat  the  effort  is  to  he  allotted  so  that  subsystem  B 
increases  in  reliability  from  0.  80  to  0.  882,  and  subsystem  C  in¬ 
creases  in  reliability  from  0.  85  to  0.  882;  whereas  subsystem  A  is 
left  alone  with  a  reliability  of  0.  V0.  The  resulting  reliability  of  the 
entire  system  is,  as  required,  0.  70  =  (.  882)^  (.  90).  This  means 
that  effort  should  be  expended  on  subsystem  C  and  B  to  raise  their 
respective  reliabilities  to  .  882  with  no  developmental  effort  spent  on 
subsystem  A.  This  policy  would  minimize  the  total  expended  effort 
required  to  meet  system  reliability  requirements.  The  minimization, 
however,  i6  dependent  upon  the  effort  function  meeting  the  initial 
assumptions. 

B-15.  Dynamic  programming  approach  to  rel. ability  apportionment. 

a.  General.  The  preceding  minimization  of  effort  algorithm 
requires  that  all  subsystems  be  subject  to  the  same  effort  function. 

If  all  subsystems  are  not  equally  difficult  to  develop,  dynamic  pro¬ 
gramming  provides  an  approach  to  reliability  apportionment  with 
minimum  effort  expenditure  when  the  subsystems  are  subject  to 
different  but  identifiable  effort  functions. 

b.  Introduction  to  dynamic  programming.  To  serve  as  a 
basis  for  formulation  of  such  problems,  a  brief  summary  of  the 
essential  elements  cf  the  dynamic  programming  procedure  follows. 

(1)  The  dynamic  programming  technique  is  applicable 

to  multi-stage  (or  sequential)  decision  problems.  The  technique  con¬ 
verts  such  a  problem  to  a  series  of  single-stage  optimization  problems. 

(2)  In  addition  tc  defining  the  stages  of  such  a  process, 
four  attributes  of  the  problem  must  be  identified  if  the  technique  is 
to  be  applied. 

(a)  5^  is  ihe  set  of  all  possible  states  ol  stage  k. 

Its  elements  are  designated  as  s^,  i.  e.  ,  t  3^. 

(b)  D1;<  is  the  set  of  all  possible  decision  alternatives 
available  at  stage  k.  Its  elements  are  designated  as  c  D^. 

(c)  T^(s^,  d^)  is  a  function  transforming  to  s^.^ 
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depending  on  the  existing  state,  sk,  of  stage  k  and  the  decision 
alternative,  d^,  selected  at  stage  k. 

(d)  Rk(ski  dk)  is  a  function  defining  the  return  rea¬ 
lized  at  stage  k  resulting  from  state  and  alternative  d^. 

(3)  An  n*stage  process  is  displayed  by  figure  D-19. 


Figure  D-lV 

n-Stage  Dynamic  Programming  Representation 

(4)  The  multi-stage  decision  problem  may  then  be  con¬ 
verted  to  a  series  of  single-stage  decision  problems  as  reflected  by 
a  set  of  recursion  equations. 

fk(*k>  =  d.^inD[Qk(?k'dk)]*k  =  1.  2 . * 

Qk(sk-dk)  Rk^k'V1  k=1 

=  Rk(sk.  dk)  •  fk-l(sk-l)>  k  =  2-  3*  •  •  •  .  n 

where  •  may  be  interpreted  as  either  an  addition  or  multiplication 
operator.  However,  it  is  used  as  a  multiplication  operator  on  condi¬ 
tion  that  the  operands  are  non- negative. 
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(5)  Tnen 


( s  ,  d  )  •  f  ,  ( s  ,) 
i  n’  n'  n-r  n-17 


J 


is  the  total  return  which  results  from  the  optimal  set 
of  decision  alternatives. 


d  -  (dj  ,  o  ^ >  «  •  .  *  d 


(6)  The  above  formulation  may  be  applied  to  a  maximiza¬ 
tion  objective  by  the  substitution  of  max  for  min.  . 

c.  Subsystems  oneruting  in  series. 

(1)  The  dynamic  programming  formulation  contained 
herein  pertains  to  apportionment  of  system  reliability  requirement 
among  series  subsystems  in  such  a  manner  to  minimize  the  total  ex¬ 
penditure  of  development  effort.  Some  basic  assumptions  which  are 
fundamental  to  the  formulation  are: 

(a)  At  any  particular  stage  of  the  development  program 
(at  time  of  apportionment),  the  system  can  be  partitioned  into  n  sub¬ 
systems  and  that  the  present  reliability  level  can  be  estimated  for  each 
subsystem.  Failure  of  any  subsystem  will  cause  system  failure.  In 
addition,  it  is  assumed  that  the  subsystem  goal  cannot  be  less  than  its 
estimated  present  level. 

(b)  The  n  subsystems  function  independently  so  that 
expected  system  reliability  resulting  from  the  subsystem  goals  can 
be  expressed  as  the  product  of  these  subsystem  goals: 


n 


where  y  is  the  system  reliability  goal  and  y^  is  the  goal  for  the 
subsystem. 


(c)  An  effort  function  can  be  identified  for  each  sub¬ 
system,  defining  the  number  of  units  of  development  effort  required 
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to  raise  its  reliability  level  from  the  present  value  to  any  potential 
reliability  goal.  The  effort  may  represent  a  single  important  re¬ 
source  or  a  combination  of  resources  if  these  can  be  expressed  by 
a  common  unit.  The  effort  function  may  be  either  continuous  or 
discrete.  A  continuous  mathematical  function  allows  the  reliability 
goal  to  assume  any  value  bevv/e^r.  the  estimated  present  level  and 
one.  A  discrete  functur  limits  potential  subsystem  goals  to  par¬ 
ticular  values. 

(2)  Consider  a  proposed  system  comprised  of  n  sub¬ 
systems,  each  of  which  are  to  be  developed  independently.  These 
subsystems  are  to  function  independently  and  in  series.  What  reli¬ 
ability  goal  should  be  assigned  to  each  subsystem  in  order  that  the 
system  goal  be  satisfied  at  a  minimum  expenditure  of  development 
effort?  Symbols  to  be  used  in  problem  formulation  are  defined  as: 

yr  =  system  reliability  goal,  0  "  y”£  1 

xj  =  reliability  level  of  subsystem  i  at  the  present 
state  of  development,  0^  x^<  1 

yj  =  reliability  goal  apportioned  to  subsystem  i, 

yil 1 


Gi(xi.  Yi)  =  units  of  development  effort  required  to  raise 
the  reliability  level  of  subsystem  i  from  xi  to  y^ 

n  =  number  of  subsystems 

y^  -  reliability  goal  apportioned  to  subsystem  i  such 
that  total  development  effort  is  minimized. 

(3)  The  problem  may  be  formulated  ~s: 
n 

minimize  X^G^Xj-yj) 
n 

subject  to  II  yi  =  y 
i=l 

xi  £Vi  l1.  i  =  1.  2.  ....  n 
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(4)  I  tic  problem  may  be  converted  to  a  dynamic  pro¬ 
gramming  p'-oblem  as  follows: 

^a)  identify  each  of  the  n  subsystems  as  a  stage  such 
that  an  apportionment  goal  must  be  determined  at  each  stage.  A  spe¬ 
cific  numbering  sequence  for  the  stages  (subsystems)  is  not  necessary, 
but  each  subsystem  must  maintain  its  assigned  identity  throughout  the 
entire  procedure. 

(b)  Define  the  set,  Sk,  of  all  possible  states,  sc,  at 
stage  k  such  that:  k 


1  = 


Sn>%-1 


>  6,  >  Sr 


(c)  Define  the  set,  Dk,  of  all  possible  decision  alter¬ 
natives,  dk  =  y^,  at  stage  k  such  that: 

xkIYk  £l.  k  =  1,  2,  ....  n. 

(d)  Define  the  transformation  function  for  stage  k: 

Tk(sk.dk):  skyk  =  sk_1(  k  =  1.  2 . n. 

(e)  Define  the  return  realized  at  stage  k  as  the 

function: 

^k^6k’  dk)  =  Gk(xk<  ^k^’  k  =  1,  2,  . ,  .  ,  n. 


(5)  The  problem  is  displayed  by  figure  D-20.  The  re¬ 
sulting  recursion  equations  are: 


V‘k>  -  7kn[ak<»k.yk)] 


^  1|  2,  * • #  t  iv* 
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Qk(skfykl  -  Gk(^k’ Vk>*  k  1 

=  Gk(sk-Vk)  +  fk-l('sk-l)'  k  "  2*  3 . n' 

and  the  optimal  set  of  apportioned  goals  will  bo  defined 
as 

,*  ,  *  *  *  * 
d  -  (y  i .  y  2  ■  •  •  •  -  v  n-  • 

Tins  problem  can  be  solved  by  means  of  a  digital 

computer. 


Figure  D-20 

Dynamic  Programming  Apportionment  Formulation 

(b)  do  exempLily  the  use  of  the  technique,  consider  a 
proposed  weapon  system  which  is  to  be  developed  as  three  indepen¬ 
dent  subsystems.  The  system  can  be  functionally  successful  if,  and 
only  if,  eac1  of  the  three  subsystems  function  properly.  In  order 
that  the  system  fulfill  its  intended  role,  it  should  be  0.  90  reliable. 
Based  on  engineering  analysis  and  historical  information  of  similar 
type  equipment,  estimates  of  the  state  of  the  art  reliability  levels 
of  the  subsystems  are  0.  95,  0.  95  and  0.  97.  What  reliability  goal 
should  be  assigned  to  each  subsystem  in  order  to  minimize  the  total 
expenditure  of  development  funds?  The  estimated  effort  (funds) 
lunctions  for  the  three  subsystems  are  contained  in  figure  D-21  where 
^-*i (xi >  y i )  *s  expressed  in  $1000  units.  Potential  apportioned  goals  are 


i 
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limited  to  those  contained  in  these  tabled  functions. 


—  — - - 

yi 

G3  <0.  95,  y j) 

Y2 

G2(0.  95,  y2  ) 

ys 

G3(0.  97,  y3) 

0.  95 

0 

u.  95 

0 

0.  9? 

0 

0.  96 

1.  0 

0.  9o 

20.  0 

0.  98 

25.  0 

0.  97 

3.  9 

0.  97 

46.  0 

0.  99 

55.  6 

0.  98 

16.  5 

0.  98 

81.  2 

0.  995 

99.  ? 

0.  99 

34.  0 

0.  99 

126.  8 

0.  995 

65.  0 

0.  995 

179.  8 

_ 

Figure  D-21 

Table  of  Effort  Functions 


(7)  First, (0.  95)  <0.  95)  (0.  97)  =  0.  875425  <  0.  90  indicates 
*  fuither  development  is  necessary  to  meet  the  system  goal. 

n  =  3 

y  =  C.  90 

-  0.96 

x2  -  0.96 

x3  =  0.97 

(8)  The  general  formulation  follows: 

min  G^O.  95,  v^'  +  G2(0.  95,  y2)  +  G3(0.  97,  y3) 

3 

subject  to  n  yj  >  0.  90 
i=l 

y  =  0,95,  0.96,  0.97,  0.98,  0.99  or  0.995. 
y2  =  0,  95,  0.96,  0.97,  0.  98,  0.  99  or  0.995 
y3  =  0.  97,  0.  98,  0.  99  or  0.  995. 
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(9)  Since  discrete  effort  functions  allow  only  specific 
values  to  be  considered  as  potential  subsystem  goals,  the  system 
goal  might  not  be  met  as  an  equality;  hence,  the  inequality  constraint. 

(10)  The  dynamic  programming  format  and  elements  are 
shown  in  figure  D-22. 


•3=1 

- ^ 

_ *  . 

subsystem 

3 

s2 

- 5 

_ 

subsystem 

2 

S1 

- ) 

_ * _ 

subsystem 

1 

4/ 

G3(0.  97,  y3) 

4> 

G2(0.95,y2) 

4 

0^(0.  95,  Vl) 

s  3y  3  =  s2 

s2y2  =  S1 

slyl  =  so 

s0  20. 90 
- -> 


Figure  D-22 

Dynamic  Programming  Formulation  Example 

(11)  The  recursion  equations  are: 
fl(sl>  =  my\n  ti(0.95,Yl)j 

f2^s2)  =  *y‘n  I  Oa(0.  95,  y2)  + 


f3(s3)  -  1  G3(0.97,y3)  +  f2(s2)  | 


(12)  Figures  D-23a,  b,  and  c  contain  the  calculated  state  trans¬ 
formations  for  stages  3,2,  and  1,  respectively,  utilizing  the  following 
relations. 

s  3  =  1 
6 2  =  S3y3 
S1  =  S2y2 


So  '  8lyl 
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0.  9215 
0.  9310 
0.  9312 
0.  9405 
0.  9408 
0.  9409 
0.  9453 
0.  9504 
0. 9506 
sj  0. 9552 
0. 9603 
0.  9604 
0.  9652 
0. 9702 
0.  9751 
0. 9801 
0.  9851 
0. 9900 


0.  95 

0.  96 

y 

0.  97 

0.  98 

0.  99 

0.  995 

0.  8754 

0.  8846 

0. 8939 

0. 9031 

0. 9123 

0. 9169 

0.  8845 

0.  8938 

0. 9031 

0. 9124 

0. 9217 

0. 9263 

0. 8846 

0.  8940 

0.  9033 

0. 9126 

0. 9219 

0. 9265 

0. 8935 

0.  9029 

0. 9123 

0. 9217 

0. 931 1 

0. 9358 

0. 8938 

0.  9032 

0. 9126 

0. 9220 

0. 9314 

0. 9361 

0. 8939 

0.  9033 

0.  9127 

0. 9221 

0. 9315 

0. 9362 

0. 8979 

0.  9074 

0.  9169 

0. 9263 

0. 9358 

0. 9405 

0. 9029 

0.  9124 

0.  9219 

0. 9314 

0. 9409 

0. 9456 

0. 9031 

0.  9126 

0.  9221 

0. 9316 

0. 9411 

0. 9458 

0. 9074 

0.  9170 

0.  9265 

0. 9361 

0. 9456 

0.  9504 

0. 9123 

0.  9219 

0.  9315 

0. 9411 

0. 9507 

0. 9555 

0. 9124 

0.  9220 

0.  9316 

0. 0412 

0. 9508 

0. 9556 

0. 9169 

0.  9265 

0.  9362 

0. 9458 

0. 9555 

0. 9603 

0. 9217 

0. 9314 

0.  9411 

0. 9508 

0.  9605 

0. 9653 

0.  9263 

0. 9361 

0.  9458 

0. 9556 

0. 9653 

0. 9702 

0. 931 1 

0. 9409 

0.  9507 

0. 9605 

0.  9703 

0. 9752 

0.  9358 

0. 945b 

0.  9555 

0. 9653 

0. 9752 

0.  9801 

0. 9405 

0. 9504 

0.  9603 

0. 9702 

0. 9801 

0. 9851 

Figure  P-23c 

State  Transformations  for  Stage  1 
(i3)  Figure  D-24a  shows  the  calculated  f°r  stage  1. 

Q,  (■j.Vj)  -  0^0.95^) 

The  circled  values  represent 


nin  f  | 

r,  I  O^s^y^J-f^Sj) 


The  blanks  represent  s0values  which  do  not  satisfy  the 
problem  constraint  that 

s  >0.  90. 

o  — 
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0.  9215 
0. 9210 
0. 9312 
0. 9405 
0. 9408 
0. 9409 
0.  9453 
0. 9504 
0.  9506 
0. 9552 
0. 9602 
0. 9604 
0.  9652 
0.  9702 
0.  9751 
0.  9801 
0.  9851 
0.  9900 


3.  9 


[m 

3.  9 

16.  5 

3.  9 

1 6.  5 

m 

3.  9 

16.  5 

L;-o 

3.  9 

16.  5 

1.0 

3.  9 

16.  5 

1.  0 

3.  9 

16.  5 

1.  0 

3.  9 

1 6.  5 

1.  0 

3.  9 

16.  5 

1.  0 

3.  9 

16.  5 

1.  0 

3.  9 

16.  5 

1.0 

3.  9 

16.  5 

1.  0 

3.  9 

16.  5 

1.  0 

3.  9 

16.  5 

1.  0 

3.  9 

16.  5 

1.  0 

3.  9 

16.  5 

16.  5 
16.  5 


34.  0 
34.  0 
34.  0 
34.  0 
34.  0 
34.  0 
34.  0 
34.  0 
34.  0 
34.  0 
34.  0 
34.  0 
34.  0 
34.  0 
34.  0 
34.  0 
34.  0 
34.  0 


Figure  D-24a 
Returns  for  Stage  1 

(14)  Figure  D-24b  shows  the  calculated  Q  (s  ,  y  )  for 

2  2  2 

Q2(S2'  72>=  G2(0-  95»  y2'+fl<si^ 

The  circled  values  are 


info 
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65.  0 
65.  0 
65.  0 
65.  0 
65.  0 
65.  0 
65.  0 
65.  0 
65.  0 
65.  0 
65.  0 
65.  0 
65.  0 
65.  0 
65.  0 
65.  0 
65.  0 
65.  0 
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Q2(VV 

0.  95 

0.  96 

0.  97 

0.  98 

0.  99 

0.  995 

0.  97 

0+16.  5 

20.  0  +  3.  9 

46.  0+1.0 

81. 2+0 

126. 8+8 

179. 8+0 

=  23.  9 

=  47.  0 

=  81.  2 

=  126.8 

=  179.  8 

0.  98 

0+3.  9 

-CT~3 

20.  0+1.0 
=  21.  0 

46. 0+0 
=  46.  0 

81. 2+0 
=  81.  2 

126. 8+0 
=  126.  8 

179. 8+0 
=  179.  8 

2 

0.99 

0+1.0 

=Q 

20. 0+0 
=  20.  0 

46. 0+0 
=  46.  0 

81.2+0 
=  81.  2 

126. 8+0 
=  126.8 

179.  8+0 
=  179.  8 

0.995 

0+1.  0 
=o 

20. 0+0 
=  20.  0 

46. 0+0 
=  46.  0 

81. 2+0 
=  81.  2 

126. 8+0 
=  126.  8 

179. 8+0 
=  179.  8 

Figure  D-  a  4  b 

Cumulative  Returns  for  Stage  2 
(15)  Figure  D-24c  shows  the  calculated  Q^fa^.y^)  for  sta8e  3. 
03(s3,y3)  =  G3(0.97.y3)  +  f2(s2) 

The  circled  value  is 


,  .  .  min  f  " 

S!*3l  =  y,  ltVVy3) 


0.  97 

y 

0.  98 

3 

0.  99 

0.995 

0.  +16.  5 
=  16.  5 

25.  0+3.  9 
=  28.  9 

55.  6+1.  0 
=  56.  6 

99.  7+1.  0 
=100. 7 

Figure  D-24c 

Cumulative  Returns  for  Stage  3 
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(16)  Then  the  optimal  decision  at  stage  3  is 

y*  =  0.97 

as  indicated  by  the  circled  value  in  figure  D-24c  and 
s2  =  s3y*  =  0.  97 

The  optimal  decision  at  stage  2,  given  s^  =  0.  97,  is 
y*  =  0.95 

as  indicated  in  figure  D-24b,  and 

8  =  s  v*  =  0.  97(0.  95)  =  0.  9215 

i  2'  2 

Similarly,  the  optimal  decision  at  stage  1,  given  that 
s^  —  0,  92 1  5,  is 

V*  =  0.  98 

as  indicated  by  figure  D-24c,  and  the  resulting 
so  =  s^*  =  0.  9215(0.  98)  =  0.  903 
which  meets  the  system  reliability  goal. 

(17)  Summarizing,  the  optimal  reliability  subsystem  goals  are 

y*  =  0.97 
y*=  0.95 
y*  =  0.  98 


and  the  total  required  expenditure  of  development  funds 
to  achieve  these  goals  is 


$1000f3(s3)  =  $1000(16.  5)  =  $16, 500 
as  indicated  in  figure  D-24c. 
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d.  Other  uses  of  dynamic  programming  relative  to  reliabil¬ 
ity.  The  dynamic  programming  optimization  technique  has  applica¬ 
tion  potential  in  other  areas  of  reliability  analysis.  For  example,  use¬ 
ful  models  have  been  developed  for  determining  an  optimal  number  of 
redundant  components  (subsystems)  subject  to  restraints  such  as  weight, 
cost,  volume,  opposing  failure  modes,  etc.  Also,  a  dynamic  program¬ 
ming  model  has  been  developed  for  providing  a  systems  approach  to 
test  planning,  i,  e.  ,  planning  for  an  optimal  number  of  tests. 
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APPENDIX  E 
RELIABILITY  DESIGN 
Section  I,  INTRODUCTION 

E-l,  Gene  ral.  This  appendix  is  intended  to  supplement  the  reliability 
design  discussion  ot  chapter  5.  It  consists  of  an  example  illustrating 
the  role  of  prediction  and  apportionment  activities  during  the  develop¬ 
ment  phase.  The  elements  of  apportionment  and  prediction  techniques 
are  described  in  chapter  4  and  illustrated  in  appendix  D, 

Section  IL  EXAMPLE  OF  RELIABILITY  PREDICTION  AND  APPOR¬ 
TIONMENT  DURING  THE  DEVELOPMENT  PHASE 

E-2.  Statement  of  Example,  a.  A  weapon  system  to  be  used  by  the 
U,  S.  Army  field  units  was  selected.  Since  this  exercise  is  for  ex¬ 
emplary  purposes  only,  duplicate  activities  will  be  eliminated  where 
possible.  In  other  words,  each  and  every  subsystein  will  not  be  sub¬ 
jected  to  the  entire  analysis  but  only  exemplary  subsystems.  All 
classified  areas  of  the  problem  were  evaded  and  data  is  hypothetical. 

b.  The  system  to  be  used  is  the  115  MM  XM70E4  towed  Rocket 
Launcher.  The  objectives  are  to: 

(1)  Predict  from  the  design  and  available  data  the  reliability 
of  the  proposed  115  MM  XM70E4  automatic  rapid  fire  field  artillery 
weapon  system. 

(Z)  Determine  whether  the  reliability  predicted  will  satisfy 
the  requirement. 

(3)  Propose  an  alternate  set  of  requirements  if  the  predicted 
reliability  does  not  satisfy  the  requirement. 

c.  The  product  is  defined  as  follows. 

(1)  Description  of  mission  environment  and  use  factors. 
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(a)  The  launcher  rocket  115  MM  XM70E4  is  a  light 
weight,  towed,  close  support  field  artillery  weapon  syBtem  capable 
of  automatically  firing  a  six  round  burst  of  115  MM  ammunition, 
highly  mobile,  helicopter  transportable,  quickly  emplaced  in  position 
to  fire. 


(b)  Transportable  by  any  helicopter  capable  of  a  3400  lb. 
load,  can  be  towed  by  any  present  in  service  vehicle  at  40  mph  highway 
travel  and  10  mph  cross  country,  also  capable  of  being  air  dropped. 

(c)  Programmed  mode  of  fire  from  single  shot  to  bursts 
of  2  to  6  rounds  of  115  MM  ammunition. 

(d)  Environment, 

2-  Thirty  percent  of  the  operation  will  be  under 
prevailing  environmental  conditions  with  a  temperature  range  between 
0  to  80  degrees  Farenheit. 

1.  Sixty  percent  of  the  operation  will  be  under 
prevailing  environmental  conditions  with  a  temperature  range  between 
80  and  105  degrees  Farenheit, 

2.  Ten  percent  of  the  operation  will  be  ut  der  pre¬ 
vailing  environmental  conditions  with  a  temperature  range  between  -25 
to  0  degrees  Farenheit. 

(e)  Use  conditions.  Twenty-five  miles  of  cross 
country  towing  per  1000  rounds  fired  under  standard  field  conditions; 

25  miles  of  helicopter  sling  transport  per  100C  rounds  of  fire. 

(2)  Performance  parameters  and  allowable  limits,  operating 
modes  and  functions,  mission  profiles  and  duty  cycles. 

(a)  The  115  MM  XM70E4  can  be  elevated  from  -5°  to 
70°.  Hand-wheeled  powered  track  traverse  20°  each  side  of  center  line 
or  40°  total.  Rapid  traverse  of  360°  by  lifting  trail. 

(b)  Fire  115MM  ammunition  in  single  shot  fashion  12 
rounds  per  minute  or  automatically  in  bursts  of  2  to  6  rounds  or  semi- 
automatically  in  single  shot  fashion  where  the  number  of  rounds  and  mode 
of  fire  is  preselected.  The  gun  has  a  six  round  magazine. 
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(c)  Emplaced  and  trained  on  target  in  less  than  3  minutes. 

(d)  Range:  Minimum  range  at  maximum  elevation  1000  m; 
maximum  range  15,000  m.  The  weapon  must  be  capable  of  changirg 
range  at  the  rate  of  lOOm/scc.  while  simultaneously  changing  the  de¬ 
flection  lay  of  the  gun  at  the  rate  of  5  degrees  of  arc/sec. 

(e)  Accuracy:  Horizontal  range  error  at  80%  maximum 
range  is  to  be  90%  of  the  rounds  within  15m  of  the  center  of  the  set 
range;  deflection  error  at  80%  maximum  range  is  90%  of  the  rounds 
within  5m  of  center  of  set  aiming  point, 

(3)  Reliability  mission  profiles. 

(a)  Mission  A.  Fire  six,  six  round  bursts;  fire  in  the 
automatic  mode.  Minimum  acceptable  reliability  is  0.  90. 

(b)  Mission  13,  Fire  20  bursts  -  each  burst  less  than  six 
rounds;  fire  in  the  automatic  mode  two  to  five  round  bursts.  Minimum 
acceptable  reliability  is  0.  95. 

(c)  Mission  C.  Same  as  mission  B.  Firing  rate  is  single 
shot  in  the  semiautomatic  n  de.  Mission  is  120  rounds  or  20  full  load 
semiautomatic  single  round  bursts.  Minimum  acceptable  reliability  is 
0,95. 


(1)  Function  and  physical  boundaries,  physical  constraints, 
operating  environment,  physical  parameters  and  configuration. 


(a)  Weights: 

Complete  weapon  w 
Recoiling  parts 
Tipping  parts 
Carriage  assembly 

(b)  Tires: 

Carriage  wheel 
Pres  sure 

(c)  Recoiling  Parts: 

Breech  Block 
Firing  Mechanism 
Recoii  System 


th  cover  3400  lbs 

1528  lbs 
1827  lbs 
1553  lbs 


7.  00  x  16,  6  ply 
45  PSI 

Swing  Pivot 
Percussion  Pin 
Hydro  Pneumatic 


E-3 


AM.CF  702-3 


(d)  Performance: 

Towing  Speed  40  mph  on  highway 

10  mph  cross  country 

Angle  of  departure  (long  tow  position)-27° 

Ground  clearance  -  10  in. 

Traverse  -  360° 

(e)  Ammunition: 

115  MM  Booster  Rocket  or 
Conventional  Projectile 

(f)  Firing  Capability 

Singie  round 
Semiautomatic 

Full  automatic  -  6  rounds  in  2  seconds 

(g)  Crew:  5 

(h)  Basic  Lists  Required 

Parts  List 

Listing  of  Parts  Lists 
List  of  Drawings 
Liiit  of  Specifications 
Equipment  List 

(i)  Mobility 

Towed 
Air  Drop 

Helicopter  Transportable 

(5)  Product  failure  is  defined  as  a  stoppage  of  function  with  no 
time  for  repair  allowed.  The  system  will  have  failed  its  mission  if: 

(a)  Mission  A  fails  to  successfully  complete  an  automa¬ 
tic  six  round  burst  (stoppage). 

(b)  Mission  B  fails  to  complete  a  burst  of  at  least  two 
rounds  and  no  more  than  five  rounds  in  auton  atic  firing  mode  (stoppage). 
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(c)  Mission  C  fails  to  fire  a  selected  single  shot  in  the  semi 
automatic  or  manually  loaded  single  shot. 

d.  Establish  reliability  model. 

(1)  The  reliability  model.  The  block  diagram  for  the  115mm 
XM70E4  weapon  system  is  a  series  of  subsystems  as  shown  in  figure  E-l. 


Figure  E-l 

Weapon  Reliability  Block  Diagram 

(2)  Alternate  modes  of  operation.  This  weapon  system  can 
function  in  either  the  single  shot  or  automatic  mode  (see  mission  pro¬ 
files). 


(3)  Mission  time  requirements  for  each  blooK.  Artillery 
weapon  system  mission  time  may  be  defined  as  mission  duration  in 
terms  of  number  of  rounds  fired.  Since  each  block  must  function  dur¬ 
ing  the  firing  of  each  round,  the  mission  times  is  the  same  for  all 
blocke  and  is  defined  as: 

(a)  Mission  A  -  36  rounds 

(b)  Mission  B  -  maximum  of  120  rounds 

(c)  Mission  C  -  120  rounds 


AMCP  702-3 


(4)  Define  reliability  of  the  product.  Reliability  of  the  weapon 
system  may  be  defined  as  the  probability  of  performing  as  indicated 
by  the  mission  profile  statements, 

E-3.  Analysis  of  reliability  requirements. 

a.  Mission  A.  (1)  Let  p  be  the  probability  of  successfully  firing  a 
single  round.  Then  the  reliability  for  a  six- round  burst  is  p  and  the 
reliability  for  6  six-round  bursts  is  (p^)^*  =  p3^1. 

(2)  Assuming  the  number  of  rounds  between  failure  (stoppage) 
to  be  exponentially  distributed,  the  reliability  requirement  may  be 
translated  to  the  probability  of  successfully  firing  a  single  round  (p), 
the  mean  rounds  between  failure(MRBF  or  0)or  to  failure  rate  (a). 

(a)  The  Mission  A  system  reliability  requirement  is 
Rs(36  rounds)  =  0,  90, 

(b)  The  required  probability  of  successfully  firing  a  single 
round  may  be  found  as  follows: 

p36  =  0.  90 

p  =  0. 901/36  =  0. 9971 

(c)  Then,  a  comparable  required  MRBF  may  be  found  as 

follows: 


exp  (  -  li  X;  =  0.  90 


V  6  J 


or 


e  = 


-  342  rounds  between  failure 


1  n(0.  90) 

(d)  The  required  failure  rate  may  be  expressed  as 
\  -  ,  ^  =  0.00292  failures  per  round 


E-6 


t 
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b.  Mission  B.  (l)  Since  this  mission  allows  for  the  automatic 
firing  of  2  to  5  rounds  in  a  burst  for  20  bursts  or  any  combination  of 
2  to  5  rounds  (e.  g.  ,  20  bursts  of  2  rounds,  3  rounds,  4  rounds,  5 
rounds  or  a  sequence  of  varied  bursts,  e.  g.  ,  2,  3,  5,  4,  2,  2,  2,  4, 

3,  2,  2,  3,  3,  3,  5,  5,  4,  4,  2  and  2)  or  a  total  of  20^  =  160,  000 
possible  mission  combinations.  It  is  an  impractical  task  to  determine 
each  possible  combination.  For  the  purpose  of  demonstration,  ten 
burets  of  2  rounds  each  and  ten  bursts  of  4  rounds  each  will  be  con¬ 
sidered  as  mission  duration  requ;rement.  (Note  total  rounds  are  even 
multiples  of  six)  In  practice  we  nay  consider  those  combinations  re¬ 
presenting  the  most  severe  requirement, 

(2)  The  system  reliability  requirement  may  be  stated  in  any  of 
the  following  ways. 


(a)  The  mission  B  system  reliability  requirement  is 


R„(60)  =  0.  90. 


(b)  The  con, parable  p  requirement  may  be  found  as  follows: 
Rs(60)  =  p60  =  0.  95 
p  =  (0.  95)1/60  =  0.  999147 


(c)  The  required  MRBF  is 


=  1170  rounds  between  failure 


(d)  The  required  failure  rate  is 

\  -  - - —  =  0.  000855  failures  per  round 

1170  y 

c.  Mission  C,  (1)  This  mission  requires  the  firing  of  20  one  shot 
full  loads  semi-automatically  (a  total  of  120  rounds). 

(2)  The  system  reliability  requirement  may  be  stated  in  any  of 
the  following  ways. 


(a)  The  mission  C  system  reliability  requirement  is 


Rs(  120)  =  0,  95. 
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(b)  The  comparable  p  requirement  is 
P  =  (0.95)1/120  =  0.9995734 

(c)  The  required  MRBF  is 

9  =  =  23^0  rounds  between  failures 


(d)  The  required  failure  rate  is 


X  = 


1 


2340 


=  0.  000428  failures  per  round 


(3)  The  mission  C  requirement  of  MRBF  =  2340  rounds 

tT/nu  neCe8?ril!  Preclude  the  MRBF  =  1170  rounds  for  missions 
nd  B  because  A  and  B  involve  fully  automatic  firing  and  mission  C 
involves  semiautomatic  firing. 


4  »  d*  t/D8»^Pti0rX8  and  9 ications  of  analysis.  In  order  to 
determine  MRBF  of  the  various  modes  it  i.  assumed  that  when  fir  mg 

weapon  a  failure  is  just  as  likely  to  occur  on  the  first  round  as  it 
on  any  other  round,  regardless  of  the  mode  of  fire.  In  the  mission 
profile  analysis  it  was  further  assumed  that  all  primary  systems  and 
other  operating  requirements  were  met.  Human  element  is  assumed 
to  have  reliability  of  1. 


E'4‘  and  active  elements, 

form  by  f  JuhrVEa-2.'>ri"“rV  Sub,y‘,e“s  *”  “°<* 
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Figure  E-2 

Block  Diagram  of  Prima.)  Subsystems 
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b.  The  recoiling  part.-,  subsystem  is  selected  to  demonstrate 
further  analysis  approaches.  Figure  F-3  shows  a  block  diagram  for 
this  primary  subsystem. 


Figure  E-3 

Block  Diagram  of  Recoiling  Parts 

c.  A  functional  complexity  description  for  each  recoiling  part 
follows: 

(1)  Breech  tube  housing  assembly,  (a)  The  breech  tube 
housing  assembly  consists  of  the  breech  housing  pawls  and  pawl  shafts, 
indexing  make-up  energy  torsiou  bar,  V-runners,  auto-cocking  shaft, 
breech  tube  indicate  signal  shaft,  and  slow  counter-recoil  signal  shaft. 

(b)  The  part  population  is: 


Breech  housing  pawls  8 

Pawl  shafts  4 

Indexing  make-up  energy  torsion 

bar  1 

V- runners  4 

Auto-cocking  shaft  1 

Breech  tube  indicator  signal  shaft  1 
Shaft  and  slow  counter  recoil 

signal  shaft  1 


E-9 


AMCP  702-  3 


(2)  Recoil  control  system,  (a)  The  recoil  system  is  a  hydro¬ 
pneumatic  arrangement.  Two  single  acting  recoil  cylinders  are  connected 
to  a  hydraulic  accumulator.  Interposed  between  the  recoil  cylinders  and 
the  accumulator  is  a  control  system  which  will  be  referred  to  as  the 
hydraulic  recoil  control. 


(b)  The  part  population  is: 

Single  acting  recoil  cylinders  2 

Hydraulic  accumulator  1 

Manifold  1 

Recuperator  1 

Recuperator  piston  1 

Recoil  pistons  1 

Buffer  pistons  1 

Buffer  cylinders  1 

Cocker  pistons  1 

Hydraulic  recoil  control  block  1 

Recoil  throttle  valve  1 

Recoil  flow  control  release  1 

Recoil  signal  orifice  1 

Check  valve  4 

Counter  recoil  flow  control  valve  1 
Counter  recoil  orifice  spool  1 

Orifice  1 

Anti-cavitation  valve  1 

Spring  actuated  relief  valve  1 

Indexing  cock  and  release  actuator  1 
Recoil  timing  valve  1 

Pressure  actuated  relief  valve  1 

Recoil  pressure  regulator  1 


(3)  Breech  tube  assemblies,  (a)  Two  assemblies,  consisting 
of  three  breech  tubes  each,  are  located  in  the  breech  tube  housing 
between  the  front  and  rear  bulkheads.  Each  assembly  is  composed  of 
three  smoothbore  tubes  fastened  to  a  spider  weldment. 
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(b)  The  part  population  is: 
Breech  tubes 
Spider 


(4)  Indexing  mechanism,  (a)  The  indexing  mechanism  is  an 
energy-conserving  type  operated  by  torsion  bar  springs.  With  this 
mechanism,  indexing  motion  is  divorced  from  recoil  motion. 


(b)  The  part  population  is: 
Cams 

Cam  rollers 
Torsion  bars 
Gears 
Worm  gear 


2 

2 

2 

6 

1 


(5)  Breech  plate  assembly,  (a)  The  breech  plate  assembly 
covers  the  rear  of  the  breech  tube  housing  and  contains  the  manual 
indexing  linkage,  firing  mechanism  and  extractor  linkage. 


(b)  The  part  population  is: 

Firing  mechanism 
Extractor  linkage 
Torsion  bar  wind-up  linkage 
Pawl  release  linkage 


(6)  Breech  block  assembly.  The  breech  block  is  a  swinging 
type  featuring  center  position  loading.  This  allows  firing  single  shots 
from  the  same  chamber  without  indexing. 

(7)  Launcher  tube.  The  single  115mm  launcher  tube  is 
mounted  in  the  indexing  mechanism  housing.  The  tube  which  weighs 
147  pounds  is  progressively  rifled.  Gunner's  quadrant  pads  are  pro¬ 
vided  on  the  top  of  the  tube  for  checking  tube  elevation. 


E-5.  Prediction  of  failure  rates  for  primary  subsystems,  a.  Recoil- 
parts  subsystem.  In  order  to  establish  failure  rates,  available  test 


E-ll 
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data,  supplemented  by  data  from  FARADA,  were  used. 

(1)  Breech  tube  housing  assembly.  Past  firing  data  on 
early  experimental  rapid  fire  weapons  of  this  type  have  shown  that 
approximately  four  failures  per  6,  000  rounds  occurred  to  the  breech 
tube  housing  assembly.  Therefore,  we  will  assign  a  failure  rate  of 
4  failures  ner  6,  000  rounds  or  1500  MRBF, 

(2)  Recoil  control  system.  The  recoil  control  system 

is  basically  a  hydraulic  system  consisting  of  hydraulic  pistons  and  a 
hydraulic  valve  network  in  a  single  manifold.  Figure  E-4  shows  a 
tabulation  of  the  number  of  different  types  of  valves  in  the  system, 
and  the  estimated  failure  rates. 


Valve  Type 

Quantity 

in 

System 

Estimated 

Failure 

Rate  * 

Total 

Failure 

Rate  * 

Check  Valves 

4 

50/10^  hrs. 

200/106  hrs. 

Control  Valves 

3 

100/106  hrs. 

300/106  hrs. 

Relief  Valves 

2 

100/106  hrs. 

200/106  hrs. 

Estimated  Total  System  Failure  Rate 

=  700/106  hrs. 

Figure  E-4 

Valve  Failure  Rate  Data 

*To  convert  failures  per  10^  hours  to  failures  per  round,  we  assume 
an  average  of  approximately  10  rounds  per  hour.  Estimated  failure 
rate  for  this  system  then  is  7  failures/  100,  000  rounds. 
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(3)  Indexing  mechanism,  The  indexing  mechanism  is 
essentially  a  gear  train,  therefore  gear  failure  rates  may  be  used  to 
estimate  the  MRBF,  Figure  E-5  shows  failure  rates  obtained  from 
FARADA  on  similar  parts. 


Part 

Quantity 

Failure 

Rate  * 

Total 

Failure 

Rate* 

Cams 

2 

1/104  hrs. 

2/ 104  hrs. 

Rollers 

2 

0.  5/ 104  hrs. 

1/104  hrs. 

Gears  (spur) 

6 

2/ 104  hrs. 

12/ 1 04  hrs. 

Worm  Gear 
Assembly 

1 

10/ 104  hrs. 

10/ 104  hrs. 

Subsystem  Total  Failure  Rate 

=  25/ 104  hrs. 

Figure  E-5 

Indexing  Mechanism  Parts  Failure  Rate  Data 

*Using  10  rounds  per  hour  as  an  average  firing  rate,  the  failure  rate 
in  terms  of  rounds  fired  is  25  failure  s/ 1  00,  000  rounds. 

b.  Other  subsystems.  (1)  No  historical  failure  data  are  available 
for  the  following  items: 

(a)  Breech  tube  assemblies 

(b)  Breech  plate  assemblies 

(c)  Breech  block  assemblies 

(d)  Launcher  tube 
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(2)  Test  firing  of  6000  rounds  on  an  early  feasibility  model 
resulted  in  no  failures  of  any  of  the  above  items.  Under  the  assump¬ 
tion  that  the  exponential  distribution  (within  the  useful  life  of  the  gun) 
applies  as  a  model,  a  lower  50%  confidence  limit  may  be  found  for  the 
MRBF. 

0  >  2x  t  _  (2H6000)  =  12000 

v*  v*  1. 386 

*  2,2r+  2  x  .  50,2 

0  >  8658  rounds  between  failure 

Then  an  upper  50%  confidence  limit  for  the  failure  rate 

is 


—  -  =  .  00011554  failures  per  round. 

8658 

This  failure  rate  ie  divided  equally  among  the  twelve 
subsystems  indicated  by  *  in  figure  E-6.  This  figure  shows  the  pre¬ 
dicted  failure  rates  including  those  for  the  primary  subsystems,  cradle 
and  equilibrator,  carriage  assembly,  and  shell  and  case. 

(3)  Historical  data  indicates  the  failure  rate  due  to  shell  and 
case  to  be  about  0.  00001  failures  per  round. 
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Subsystems 

Failures  per 

10J  rounds 

MRBF 

Recoiling  Parts 

1)  Breech  tube  housing 

assembly 

66. 

1,  516 

2)  Recoil  control  system 

7. 

14, 286 

3)  Breech  tube  assemblies* 

0. 96283 

108, 605 

4)  Indexing  mechanism 

25. 

4,  000 

5)  Breech  plate  assembly* 

0. 96283 

108, 605 

6)  Breech  block  assembly* 

0. 96283 

108, 605 

7)  Launcher  tube* 

0. 96283 

108, 605 

Total 

101.  85132 

982 

Cradle  and  Equilibrator 

1)  Cradle* 

2)  Equ'librators* 


0. 96283 
0. 96283 


To’al 


Shell  and  Case 


*  See  preceding  page 


Figure  E-6 

Predicted  Failure  Rates 


108, 605 
108, 605 


51,  814 


100, 000 
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E-6.  Predicted  system  failure  rate.  The  predicted  system  failure  rate 
may  be  calculated  as  the  sum  of  the  primary  system  failure  rates. 

101.85  +  1.  93  +  5.78  +  1.00  -  110.  56  failuree  per  10  rounds. 

E-7.  Comparison  of  predicted  failure  rate  with  requirements. 

a*5  A,  Failure  rate  is  required  not  to  exceed  292  failures 

per  10  rounds.  Then  the  present  state  of  development  is  sufficient  to 
satisfy  Mission  A  reliability  requirements, 

b. ^  Mission  B.  Failure  rate  is  required  not  to  exceed  85.  5  failures 
per  10  rounds.  Then  the  system  requires  further  development  to 
satisfy  Mission  B  reliability  requirements. 

c.  Mission  C.  Since  Mission  C  pertains  to  semiautomatic  firing 
which  has  performance  features  different  than  those  for  A  and  B,  the  pre¬ 
diction  procedure  would  be  similar  to  that  for  A  and  B,  and  will  be  omitted 
for  this  example.  Due  to  the  nature  of  Mission  C  there  would  be  certain 
vital  differences  in  the  block  diagram  of  time  system,  for  example  only  (1) 
breech  tube  assembly  need  be  operational,  the  indexing  mechanism  and  re¬ 
coil  control  assembly  would  not  need  to  work. 

E-8.  Apportionment  of  reliability  goals  to  primary  subsystems. 

a.  In  order  for  the  system  to  meet  its  Mission  B  requirements  it  is 
necessary  to  apportion  the  reliability  requirements.  Certain  components 
of  the  system  will  require  improved  reliability  so  that  the  overall  system 
reliability  will  be  increased  sufficiently  to  meet  the  Mission  B  require¬ 
ment.  A  systematic  method  of  reapportioning  reliability  is  needed.  Some 
factors  to  be  considered  are  cost  and  technical  complexity. 

b.  The  minimization  of  effort  algorithm  (appendix  D)  may  be  utilized 
to  apportion  the  goals  for  Mission  B. 

(1)  Determine  the  present  predicted  reliability  level  for  each 
primary  subsystem  and  rank  from  lowest  to  the  highest  in  value. 


Cradle  and  C  cirriage  Shell 


Recoiling  Parts  Equilibrator _  Assembly _  and  Case 


R  _  -60/982 
rtrp  -  e 

^ce 

=  e  -  60 /  51,  814 

Rea 

_  e-60/17272 

Rsc*  ’ 

R  0611 

Krp  e 

^ce 

-0.  00117 

=  e 

Rea 

-0. 00347 

=  e 

Rrp  =  0.  94073 

Rce 

=  0. 99883 

R-ca 

<r» 

=  0.  99653 
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Let  R 


rp  -  K1 


Let  Rca  =  R? 


Let  Rce  -  R3 


Ri  <  R2  <  *3 

Ignore  Rgc  since  it  is  one. 


Compute 


J 


r  R 

!  — nTI -  ' 

n  Rt  ; 

w  i=j+i  J 


i/j 


R*  is  the  mission  reliability 


ri=  r-a* 

*  1  D  n 


il/l 


L  R2R3 


0.  95 


(0.  99653)(0.  99883) 


=  0. 954425 


.  (Ri *  0.  940731  <(ri  =  0.954425) 

r,  .  r_K-L-|1/2- 

2  .  *3  J 

(R2  s;  0.  99653)  >  (r2  =  0,  97525) 

Rj  is  the  only  system  that  mast  be  improved,  i.  e.  ,  Rrp  must  be 
increased  from  0.94073  to  0.954425. 

(2)  It  is  now  necessary  to  determine  which  of  the  compon¬ 
ents  of  the  primary  system  should  become  more  reliable.  Repeating 
the  above  procedure  for  the  recoiling  parts  subsystem  for  a  required 

level  of  R*  =  0.  954425. 
rP 


f  0-  95 


0. 99883 


1/2 


0. 97525 


Breech  tube  housing  assembly 
Recoil  control  system 
Breech  tube  assembly 


R  =  e-60/'1516  =  0.96120  =  Ri 
R  =  e-60/14,  286  =  0.99581  =  R3 
R  =  e60/l08,  605  _  0>  99945  =  r4 
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indexing  mechanism 
Breech  plate  assembly 
Breech  block  assembly 
Launcher  tube  assembly 


R  =  e-60/4000  ,  0.98511  =  R2 
R  =  e- 60/108,  605  _  0_  99945  -  r^ 

R  -  e-60/108,  605  .  o  99941;  _  R^ 
r  =  g-60/108,  605  _  o,  99945  -  R? 


R1  i  r2  £  R3  £  R4  i  R5  £  R6  1  R7 


r 

J 


”  i=jrl 


R* 

R. 


1/j 


rl 


_  f  0,  954425 

I  r2r3r4r5r6r? 


1/1 


f. _ 0.  954425 _ 

JO.  98511)(0.  9 9 581  )(0 .  99945)4 


0. 97507 


(Rx  =  0,  96120)  <  (rj  =  0.  97507) 


r  e  r  0.9544255  T. 
2~  [  (0.  99 531  )(0.  99945)  _ 

(R2  =  0.  98511)  >(r2  =  0.  96055) 


0. 96055 


The  breech  tube  housing  assembly  is  the  only  subsystem  that  must  be 
improved.  Therefore  in  order  for  the  recoiling  parts  to  acquire  a 
reliability  0.  954425,  the  breech  tube  housing  assembly  reliability 
must  be  increased  from  0,  96120  to  0.  97507. 

(3)  Then  for  Mission  B 


Ra  =  RrpRceR 


caRsc 


R8  =  (0.  954425)(0.  99883)(0.  99653X1) 


Rs  -  0.95 


E-18 


'  I 


AMCP  702-3 

The  breech  tube  housing  assembly  must  have  a  reliability  of  0.  97507 
or  a  maximum  failure  rate  of 


-  In  (0.  9750  i ) _ _  ^  failures  per  10^  rounds 


E-9.  An  alternate  method  ot  apportionment.  a.  The  procedure  of 
Minimum  Effort  illustrated  above  assumes  that  the  effort  (time,  money, 
resources,  etc.  )  to  be  expended  in  improving  any  of  the  subsystems  is 
equivalent.  Obviously  this  is  not  always  a  good  assumption.  A  more 
general  approach  to  the  problem  is  the  technique  of  dynamic  programming 
described  in  appendix  D. 

b.  This  technique,  though  general  in  nature,  requires  that  a  cost 
and  improvement  relationship  be  specified.  As  a  result  it  is  more 
definitive  and  requires  knowledge  about  the  economy  of  improving  specific 
subsystems  such  as  cost  of  improvement  per  incremental  jump. 

c.  Since  there  are  no  such  data  available  for  the  preceding  system, 
a  hypothetical  cost  function  will  be  used  as  an  example.  The  problem 
may  be  formulated  as  follows, 


Minim  lze 


G,  (xlf  yt) 


Subject  to  y  >  y 

<Yi  <  1 

Xj  is  the  existing  reliability  level  of  subsystem  i 

y^  is  the  level  to  which  subsystem  i  should  be  improved. 

Gj  (xj  ,  yj  )  =  amount  of  effort  required  to  raise  the  reliability 
level  of  subsystem  from  to  y^  . 
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n 

G{0.94,yi) 

1 

G2(0.  99883,  y2) 

I 


.  94 
.  945 
.  95 
.  955 
0.  96 
0.  965 
0.  97 
0.  975 


0 
4 
12 
48 
2400.  0 
14,  400.  0 
100,  800. 0 
907,  200.  0 


0. 99883 
0. 9990 
0. 9992 
0. 9994 
0. 9996 
0. 9998 
0. 9999 
0. 99999 


2400. 0 
12000. 0 
72000. 0 
504000. 0 
4032000. 0 


0. 9965 
0. 9970 
0. 9975 
0. 9980 
0. 9985 
0. 9990 
0. 9995 

0_  QQQQ 


Gj(0.  9965,  y3) 


0 

100 
200 
600 
2400 
12, 000 
72, 000 
504, 000 


Figure  E-7 

Coat  Function  for  Increasing  Reliability 

The  computer  yields  the  following  solution 
Subsystem  1  Goal  =  0.  95500 

Subsystem  2  Goal  =  0.  99883 

Subsystem  3  Goal  =  0.  99650 


E-20 


s. 


AMCP  702-3 


f 

Requiring  480.00  units  of  effort  (cost) 


) 


) 


Rg  =  R:R2R3  =  0.  95054 


This  indicates  that  the  recoiling  parts  subsystem  relia¬ 
bility  should  be  increased  to  0.  95  5. 

E-10.  Stress-strength  design.  In  the  design  of  mechanical  hardware, 
the  interrelationship  of  stress  -  strength  distributions  is  often  inves¬ 
tigated  to  insure  that  the  probability  of  over-stress  failures  is  at 
an  acceptable  level.  This  method  of  statistical  design  evaluation 
utilizes  the  estimated  or  known  stress  levels  to  be  encountered  in 
conjunction  with  material  properties,  in  order  to  obtain  a  design 
which  normally  minimizes  weight  and  cost  due  to  overdesign.  De¬ 
sign  engineers  who  use  strength  of  materials  techniques  will  find 
this  method  easy  to  master  and  useful  when  reliability  is  of  prime 
concern. 


E-l  1.  Summary,  a.  The  entirety  of  this  appendix  has  been  to  ex¬ 
emplify  early  prediction  and  apportionment.  The  numerical  accuracy 
used  has  been  unrealistic  in  the  face  of  grossly  estimated  data  and 
simplifying  assumptions. 

b.  It  should  also  be  noted  that  there  are  several  procedures 
available  for  prediction  and  apportionment,  all  of  which  must  be 
modified  to  satisfy  a  given  project.  The  methodology  described  here¬ 
in  was  to  demonstrate  the  procedure  and  was  chosen  primarily  for 
ease  of  discussion. 
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APPENDIX  F 

DEMONSTRATION  AND  TESTING 
Section  I.  INTRODUCTION 

F-l.  Gene ral.  a.  The  materials  contained  in  this  appendix  are 
intended  to  supplement  the  discussions  in  chapter  6.  The  content 
includes  some  typical  statistical  analysis  techniques  associated  with 
reliability  demonstration  and  testing  along  with  some  brief  examples. 
This  is  not  an  exhaustive  coverage  of  available  techniques,  but  a 
summary  of  some  typical  and  basic  techniques.  A  more  thorough 
coverage  may  be  found  in  the  various  published  reliability  literature. 

b.  These  techniques  pertain  to  inferences  about  certain  reliability 
related  parameters  from  sample  te9t  results.  Coverage  includes 
both  estimation  of  and  hypothesis  tests  about  such  parameters.  The 
distributions  and  parameters  covered  are  those  discussed  in  appen¬ 
dix  A. 


Section  II.  PARAMETER  ESTIMATION 

F-2.  General,  a.  The  principles  of  statistical  estimation  may 
be  applied  to  the  results  of  sample  tests  to  estimate  reliability 
parameters.  The  principle  of  parameter  estimation  may  be  illus¬ 
trated  by  considering  a  random  variable  X  with  a  density  function 
f(x)  which  is  described  by  a  parameter  8.  Suppose  we  make  n 
independent  observations  on  X,  i.  e.  ,  x^,  x  ,  .  .  .  ,  x^.  Analysis 
of  these  values  will  allow  us  to  estimate  8  by:  11 

(1)  A  point  estimate  designated  as  6  and/or 


(2)  A  confidence  statement  that 
A  <  6  <B 


where  A  and  B  are  dependent  upon  the  specified  degree  of  confidence 
required  and  may  be  found  by  performing  an  appropriate  analysis  on 
the  sample  observations. 
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F-3.  Nonparametric  analysis,  a.  Nonparametric  procedures 
for  estimation  of  reliability  are  useful  when  the  underlying  distribu¬ 
tion  of  failure  times  cannot  be  identified.  The  method  considered 
herein  will  utilize  the  binomial  distribution  approach  to  estimation  of 
equipment  reliability  and  may  be  used  to  obtain  estimates  of  reliability 
from  a  nonreplacemenc,  time-terminated  test  if  the  mission  time  is 
equal  to  test  termination  time.  The  reliability  for  a  mission  time  of 
T,  i.e.  R(T),  may  be  defined  as  that  portion  of  the  population  which 
would  not  fail  during  a  mission  whose  length  is  equal  to  the  test 
duration  time  T. 

b.  Consider  a  nonreplacement  life  test  which  will  be  ter¬ 
minated  at  time  T  where  n  sample  items  are  placed  on  test.  Let  r 
be  the  number  of  failed  items  and  d  be  the  number  of  items  which  did 
not  fail. 

(1)  A  nonparametric  point  estimate  of  R(T)  is 

A  A 

R(T)  =  -2— 
n 

(2)  Table  H-7  of  appendix  H  provides  90%,  95%,  or  99% 
lower  one-sided  confidence  limits  for  R(T)  if  n  30.  The  table 
headings  contain  directions  for  its  use.  Table  H-8  provides  two-sided 
confidence  limits. 

(3)  A  lower  100(1-  a)%  confidence  limit  for  R(T)  may  also 
be  found  by 


R(T)> - i - 

1  +  ri— i-i_  F 

''P  -  r  y  a,  2r  +  2,  2n-2r 

where  «  is  the  likelihood  that  the  statement  is  incorrect  (and  is  the 
complement  of  the  confidence  level);  n,  T  and  r  are  as  defined  above; 
and  Fft  2r-|->  2n-2r  may  be  found  in  table  H-5  of  appendix  H. 

This  method  is  not  limited  tc  90%,  95%,  and  99%  confidence  levels 
encountered  above. 
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c.  To  illustrate  the  estimation  technique  and  the  concept  of 
confidence  statements,  consider  a  nonreplacement  test  which  is 
to  be  terminated  after  40  hours.  Twenty  type  xxx  batteries  were 
placed  on  tost  and  after  40  hours,  12  items  had  not  yet  failed. 
Assuming  the  underlying  failure  distribution  to  be  unknown,  esti¬ 
mate  battery  reliability  for  a  40-hour  mission  by  means  of  a  point 
estimate  and  a  90%  confidence  interval. 


(1)  n  =  20,  r  =  8  failures,  and  d  =  12  survivors. 

(2)  R(40)  =  —  =  0.  60  which,  based  on  these  sample  test 

20 

results,  represents  a  point  estimate  of  R(40)  for  such  batteries. 

(3)  Using  table  H-7,  a  90%  lower  confidence  limit  for 
R(40)  >0.433.  That  is,  we  are  90%  confident  that  the  battery  reli 
ability  for  a  40-hour  mission  time  is  greater  than  0.  433. 


(4)  Using  the  preceding  formula  fora  =  0.  10  and  F 


1.75  (as  found  by  interpolation  in  table  H-5): 

1 


.  10,  18, 


R(40)> 


1 


"l  +  '  8+1 


VTTTT-g- 


1.75 


1+1.31 


=  0. 433 


This  agrees  with  the  tabular  determination. 


d.  The  same  procedures  may  be  applied  to  nontime  depen¬ 
dent  or  one  shot  items  for  purposes  of  estimating  the  portion  of 
items  (p)  which  successfully  fulfill  a  mission.  To  exemplify  this, 
consider  a  sample  of  twenty  rounds  of  ammunition  which  have  been 
proof  fired  and  two  did  not  function  properly.  Estimate  p  by  means 
of  a  point  estimate  and  by  a  95%  lower  confide.nce  limit. 

(1)  Define  the  following: 


n  =  20 

r  =  2  failures 
d  =  18  successes 
a-  .  05 

F  05  4  36  ~  from  Table  H-5. 
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(2)  A  point  estimate  of  p  is  f?  =  —  =  =  0,  90. 

(3)  Using  table  H-7,  a  95%  lower  confidence  limit  for 

p  is 


p  >  0. 717 

In  other  words,  there  is  95%  confidence  that  at  least  0.  717  of  all 
rounds  will  perform  successfully. 


(4)  By  formula,  a  95%  lower  confidence  limit  for  p  may 
be  found  as 


P  ^ 


_ i_ 

1 .  44 


0.  694 


F-4.  Determination  of  underlying  distribution,  a.  More  precise 
estimates  of  reliability  parameters  can  be  obtained  if  the  underlying 
distribution  of  failure  times  can  be  determined.  Certain  goodness  of 
fit  tests  can  be  applied  to  test  failure  times  for  determining  whether 
a  hypothesized  distribution  is  a  reasonable  model.  Both  graphical 
procedures  and  statistical  methods  are  included  herein  for  this  pur¬ 
pose. 

b.  Exponential  graphical  procedure. 

(1)  Semi-log  graph  paper  may  be  used  to  determine  the 
validity  of  the  assumption  that  the  underlying  distribution  is  exponen¬ 
tial.  The  vertical  scale  of  this  graph  paper  is  logarithmic  and  the 
horizontal  is  arithmetic.  Given  a  sample  of  size  n  resulting  in 

failure  times  x  ,  x  ,  .  .  .  ,  x  ,  the  graphical  procedure  follows: 

12  n 

(a)  For  each  failure  time,  compute  — n.+  . _ _  where 

n  +  1  -  i 

i  =  1,  2,  3,  .  .  .  ,  n  and  stands  for  the  failure  number. 

(b)  Plot  the  points  ^x.,  — 5_j— 1 "\  where  x.  is  found 

V  1  n  +  1  -  i  J 
n  +  1 

on  the  horizontal  arithmetic  scale  and  n  +  1  -  i  on  the  vertical 
logarithmic  scale. 
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(c)  Draw  a  straight  line,  through  the  origin,  which 
best  fits  the  trend  indicated  by  these  points. 

(d)  If  this  line  provides  a  good  indication  of  the  trend, 
the  underlying  distribution  may  be  considered  exponential.  The 
decision  is  qualitative  and  is  dependent  upon  the  decision  maker. 

(2)  To  exemplify  the  use  of  this  graphical  procedure, 
consider  a  life  test  of  10  sample  widgets  which  resulted  in  failure 
times  of  0.  8,  0.9,  1.9,  2.  4,  2.8,  4.  I,  4.  4,  6.  2,  10.2  and  12.  4 
hours.  Using  semi-log  paper,  determine  graphically  whether  the 
underlying  distribution  of  failure  time  may  be  considered  exponential. 

(a)  Figure  F-l  contains  the  calculated  coordinates  to 
be  plotted  (n  =  10). 

(b)  Figure  F-2  is  a  semi-log  graph  plotted  from  these 

coordinates. 


i 

xi 

n  +  1 

n  +  1  -  i 

i 

0.  8 

1.  10 

2 

0.  9 

1.  22 

3 

1.9 

1.  38 

4 

2.  4 

1.  57 

5 

2.  8 

!.  83 

6 

4.  1 

2.  20 

7 

4.  4 

2.75 

8 

6.  2 

3.  67 

9 

10.  2 

5.  50 

10 

12.  4 

1 1.  00 

F  igure  F-l 

Exponential  Coordinates 
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(c)  The  resulting  concerning  the  underlying 

distribution  is  qualitative  and  depends  up.  n  how  well  a  straight  line 
fits  the  plotted  points.  In  this  example,  a  straight  lme  trend  is  rather 
pronounced  and  an  underlying  exponential  distribution  is  reasonable. 

c.  Weibull  graphical  procedure. 

(1)  Various  types  of  V  ^ull  probability  paper  are  avail¬ 
able  for  determining  the  validity  ox  assumption  that  the  underlying 
distribution  of  failure  times  is  We:  11.  The  Weibull  paper  used  be¬ 
low  utilizes  four  scales.  For  purpo  es  of  discussion,  the  scales  shall 
be  identified  A,  D,  C  and  D  as  shown  in  figure  F-3.  Given  a  sample 
of  n  items  with  failure  times  x ,  ,  x2,  •  •  •  ,  xn,  the  graphical  procedure 
follows : 


(a)  For  each  failure  time  compute  — V.  where 

n  +  1 

i  =  1,  2,  ....  n  stands  for  the  failure  number. 

(b)  Plot  the  coordinates  f  j  on  scales  A 

and  B,  respectively,  V  / 


(c)  Draw  a  straight  line  which  best  fits  the  trend 
indicated  by  these  points. 

(d)  The  decision  concerning  the  validity  of  the  Weibull 
assumption  depends  upon  how  well  the  line  fits  the  plotted  points.  A 
good  fit  indicates  that  a  Weibull  distribution  is  a  reasonable  failure 
model. 


(e)  The  parameters,  5  and  r| ,  of  the  Weibull  distri¬ 
bution  may  also  be  estimated  by  graphical  procedures. 

_1  Draw  a  line  through  the  point  (1,  0),  referring 
to  scales  C  and  D  respectively,  parallel  to  the  original  trend  line. 

ji  Find  the  value  from  the  D  scale  corresponding 
to  the  point  of  intersection  of  the  parallel  line  with  the  0.0  axis  of  the 
C  scale.  This  value  is  an  estimate  of  3  . 
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_3  Find  the  value  from  ‘.he  A  scale  corres¬ 
ponding  to  the  point  of  intersection  of  the  trend  line  with  the  0.  0 
axis  of  the  D  scale.  This  value  is  an  estimate  of  the  parameter  rp 

(f)  If  the  trend  of  plotted  points  is  something  other 
than  a  straight  line,  the  assumption  of  a  two-parameter  Weibull 
distribution  is  rejected. 


C 


A 

F igure  F- 3 
Weibull  Paper  Scales 


(2)  To  exemplify  the  use  of  this  graphical  procedure, 
consider  a  life  test  of  9  vacuum  tubes  resulting  in  failure  times  of 
2.0,  3.7,  5,3,  6.2,  8.5,  9.4,  11.1,  16.0,  and  18.  8  hours.  Using 
Weibull  probability  paper,  determine  graphically  the  validity  of  the 
assumption  of  an  underlying  Weibull  distribution.  If  the  assumption 
is  valid,  estimate  the  parameters  P  and  r|  . 

(a)  Figure  F-4  shows  the  coordinates  to  be  plotted  and 

the  plot  of  ;‘  X;,  ■  [is  shown  by  figure  F-5. 

\  n  +  1  / 

(b)  Since  the  trend  line  fits  the  plotted  points  quite 
well,  the  Weibull  model  of  failure  times  is  reasonable.  As  indicated 
by  the  graph,  estimates  ofp  and  r;  are  1.35  ar.d  10.5  respectively. 
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Figure  F-4 
Weibull  Coordinates 


d.  Normal  graphical  procedure. 


(1)  Normal  probability  paper  may  be  used  to  determine 
the  validity  of  the  assumption  that  the  underlying  distribution  is  normal. 
This  graph  paper  consists  of  a  horizontal  arithmetic  scale  and  a  verti¬ 
cal  probability  scale.  Given  a  sample  of  n  items  with  failure  times 
X1  £  x2  —  —  xn’  8raP^cal  procedures  follow: 


(a)  For  each  failure  time,  compute  .122jp 
n  stands  for  the  failure  number. 


(b)  Plot  the  points 


^xi'irrr  ) 


f  100i 
x.  , 


where  x; 


the  arithmetic  scale  and 


IPO  i 
n  +  1 


on  the  probability  scale. 


where  i  =  1, 


is  found  on 
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(c)  If  the  trend  of  the  points  can  be  represented  by  a 
straight  line,  the  assumption  of  a  normal  underlying  distribution  is 
reasonable . 

(2)  Nine  rounds  have  been  fired  in  a  certain  type  gun. 

The  resulting  chamber  pressure  values  were  1.  100;  1,  500;  2,  300; 

2,  500;  2,  600;  3,  200;  3,  300;  3,  400  and  3,  600  psi.  Using  normal 
probability  paper,  determine  graphically  the  validity  of  the  assump¬ 
tion  of  an  underlying  normal  distribution  pressure  values. 

(a)  Figure  F-6  indicates  the  coordinates  to  be  plotted, 
the  plot  of  (x.,  199.}  I  on  normal  probability  paper  is  as  shov/n  by 

\  »  n  +  1  J 

figure  F -7. 
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Figure  r  -6 
Normal  Coordinates 

(b)  Since  a  straight  line  fits  the  trend  of  plotted  points, 
the  assumption  of  normality  is  reasonable. 
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}  e.  Chi- squared  goodness  of  fit  test, 

(1)  The  x*  goodness  of  fit  test  may  be  used  to  test  the 
validity  of  any  assumed  distribution,  either  discrete  or  continuous. 

The  test  may  be  summarized  as  follows  for  a  continuous  distribution. 

(a)  Determine  the  underlying  distribution  to  be  tested. 

(b)  Determine  a  level  of  significance,  a  ,  which  is 
defined  as  the  risk  of  rejecting  the  underlying  distribution  if  it  is,  in 
fact,  the  real  distribution. 

(c)  Divide  the  continuous  scale  into  intervals.  For 
reliability  analysis,  this  scale  is  usually  time. 

(d)  Determine  the  number  of  sample  observations 
falling  within  each  interval. 

(e)  Using  the  assumed  underlying  distribution,  deter¬ 
mine  the  expected  number  of  observations  in  each  interval.  Combining 
of  intervals  may  be  required  because  the  expected  number  of  observa¬ 
tions  in  an  interval  must  be  at  least  2.  5.  This  determination  may  re- 

^  quire  an  estimation  of  the  distribution  parameters  from  the  sample  data. 

/• 

(f)  Compute 


i=l  i 


where 

Oi  =  number  of  sample  observations  in  the  interval. 
E^  =  expected  number  of  observations  in  the  i1^  interval, 
k  =  number  of  intervals 
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(g)  if  x2 


I 


A 


Where  w  is  the  number  of  parameters  estimated  and  X  *  a  ^  w  j 

may  be  found  in  table  H-3of  appendix  H,  reject  the  distribution 
under  test.  Otherwise,  we  do  not  have  sufficient  evidence  to  reject 
the  assumed  underlying  distribution, 

(2)  To  illustrate  the  use  of  the  X*  goodness  of  fit  test, 
consider  the  data  in  figure  F-8  indicating  the  failure  times  obtained 
from  testing  a  sample  of  100  fuel  systems.  Using  a  significance  level 
of  .  05,  test  whether  the  assumption  of  an  exponential  distribution  is 
reasonable.  The  sample  mean  was  found  to  be  8.  9  hours. 


Interval  (Hours 

F  reauencv 

0 

- 

5  05 

48 

5.  05 

- 

10.  05 

22 

10.  05 

-> 

15.05 

1 1 

15.  05 

- 

20.  05 

7 

20.  05 

- 

25.  05 

3 

25.  05 

- 

30.  05 

5 

30.  05 

- 

35.  05 

2 

35.  05 

- 

40.  05 

0 

40.  05 

- 

45.  05 

1 

45.  05 

- 

50.  05 

0 

50.  05 

- 

55.  05 

_ 1_ 

100 

Figure  F-8 

Fuel  System  Failure  Times 
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where  TJ.  and  L.  are  the  upper  and  lower  limits  of  the  il  interval, 

U:  =  L.  ,  and  *6  =  8,  9  hours, 

1  i+l, 


(c)  Some  of  the  original  intervals  were  combined  to 
satisfy  the  requirement  that  no  E.  value  be  less  than  2.  5. 


7 

-  V" 

i=l 


/ 

VPi 


-  E 


4.  18 


E. 

i 


"Xa,k-w-l  =  X. 05, 7-1-1'  x*.  05, 5  "  1  070  (table  H-3,  appendix  H). 


7  V° 
Since  2  V 


i-1  E> 


V  =  4.  18  < 


.  05.  5 


=  11. 070,  we  do  not  have 


sufficient  evidence  to  reject  the  exponential  distribution  as  a  model 
for  these  failure  times. 


f.  Kolmogorov-Smirnov  goodness  of  fit  test. 

(1)  The  preceding  X*  goodness  of  fit  test  is  limited  to  a 
reasonably  large  sample  size.  The  Kolmogorov-Smirnov  test  is 
useful  for  a  small  sample,  as  well  as  for  large  samples,  but  is 
limited  to  tests  concerning  continuous  distributions.  This  test 
requires  that  the  parameters,  as  well  as  the  underlying  distribution 
type,  be  included  as  a  part  of  the  assumption  or  hypothesis  being 
tested.  The  Kolmogorov-Smirnov  goodness  of  fit  test  procedure  is 
as  follows: 


(a)  Determine  the  underlying  distribution  and  asso¬ 
ciated  parameter  values  to  be  tested. 

(b)  Determine  the  level  of  significance. 

(c)  Using  the  assumed  distribution  and  parameters, 
compute  F(x^)  =  P(X  ^x^)  where  is  the  i^1  sample  observation. 

A 

(d)  F rom  the  sample  data,  compute  F(x.)  =  the  por¬ 
tion  of  the  sample  observations  which  are  less  than  or  equal  to  x.. 
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(e)  Determine  the  maximum  value  of 

I  F(xi)  *^(xi)  I  =  d. 

(f)  If  d  >  d  ,  reject  the  assumed  distribution  and 
associated  parameters.  Rejection  would  be  the  result  of  evidence  that 
either  the  underlying  assumed  distribution  or  the  assumed  parameters 
or  both  are  not  realistic.  Values  of  dft  may  be  found  in  table  H-6 
appendix  H. 

(2)  To  exemplify  the  Kolmogoro v-Smirnov  test,  consider 
five  sample  components  which  have  been  life  tested  with  the  following 
failure  times:  1,  5,  6,  8  and  10  hours.  Test  the  assumption  that  the 
underlying  distribution  of  failure  times  is  normal.  Use  an  a  risk  of  0.  20. 

(a)  Since  no  assumed  parameters  are  given,  we  shall 
use  the  sample  mean  (x)  and  sample  standard  deviation(s). 

xi  xi2 


30  226 


(b)  The  calculation  of  d  is  shown  in  figure  F-10. 
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xi 

BB 

F(x.) 

A 

F(Xi> 

Sf(x.>  -  F(Xi)  1 

1 

-1,47 

.  07 

1/5*  •  20 

.  1  3  max 

5 

-0.  29 

.  39 

2/5  =  .40 

.  01 

6 

0 

.  50 

3/5  =  .60 

.  10 

8 

.  59 

.  72 

4/5  =  . 80 

,  08 

10 

1.  18 

.  88 

5/5  =  1.00 

.  12 

Figure  F-  1 0 

Calculation  of  d  Statitistic 


F(Xi)  =  P(X  <  Xi)  = 
F(Xi)  =  l-p  /  Z  > 


which  becomes 


\ 

y 


when  the  sample  values  are 


uBed  as  parametei  s. 

(cj  Then  d  -  maximum  absolute  difference  =  .  13. 


dG  -  d  2Q  =  0.  *46  (table  H-6) 

Since  d  =  .13<  d  =  .446,  we  have  no  reason  to 
reject  the  assumption  of  normality  with  M  -  6  and  =  3,4 

F-5,  Exponential  distribution  of  failure  times. 

a.  General. 


(1)  The  exponential  distribution  is  often  assumed  as  the 
failure  time  model.  In  the  case  of  complex  equipment,  this  assump¬ 
tion  is  generally  reasonable. 
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The  exponential  probability  density  function  has  been  defined  as 

1  /  x  \ 

f(x)  =  A  exp(-  A  x)  -  ig  exp  ,  .  if  x  >  0 


f(x)  =  0  if  x  <  0 

where  X  =  failure  rate 

and  6  =  J;  =  mean  failure  time. 

A 

(2)  Then  the  parameter  to  be  estimated  from  sample  life 

test  data  is  either  6  or  X  .  A  point  estimate  of  the  exponential  para¬ 
meter  leads  to  a  point  estimate  of  the  reliability  function.  Each  can 
also  be  estimated  by  means  of  confidence  statements.  The  symbols 
^  ^  and  i^(x)  are  used  herein  as  point  estimates  of  the  para¬ 

meters  8,  X  and  R(x)  respectively.  The  value  for^  will  not  be 

shown  but  may  be  determined  as  ^  =  JL 

u 

(3)  Temple  data  may  be  generated  from  different  types  of 
life  tests.  Life  test6  may  be  conducted  either  with  or  without  replace¬ 
ment  of  failed  components  and  may  be  terminated  either  upon  the  oc¬ 
currence  of  a  preassigned  number  of  failures  or  at  a  preassigned  time. 

b.  Life  tests  terminated  upon  the  occurrence  of  a  preassigned 
number  of  failures. 

(1)  As  suming  an  exponential  distribution  of  failure  times, 

ccnsider  a  life  test  which  is  to  be  terminated  upon  the  occurrence  of 
the  r*^1  failure  --  i.  e,  ,  n  items  are  placed  on  test  until  the  rt^1  failure 
occurs.  The  failure  times  are  expressed  as  x^<  <  .  .  .  <  xf.  The 

method  for  estimating  9  or  X  depends  upon  whether  the  test  procedure 
involves  replacement  or  nonreplacement  of  field  items. 

(2)  Point  estimates  of  0  and  R(x)  are 

r 

T  x  +  x  (n-r) 

a  i=  I  i  r  , 

6  _ _ for  the  nonreplacement 

r  test,  failure  te rmir.ated 
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for  the  replacement  test 
failure  terminated 


for  either  case  of 
failure  terminated  test 

(a)  Ten  engines  are  initially  to  be  placed  on  test  without 
replacement,  until  the  third  failure  occurs.  At  the  conclusion  of  the 
test,  the  resulting  failure  times  were  found  to  be  6,  8,  20  hours. 
Assuming  an  exponential  distribution  of  failure  times,  find  a  point 
estimate  of  the  mean  failure  time  0  and  of  R(5). 

r  =  3 

n  =  10 


£  x.  =  34 
i=l  1 

^  =  21 iJm.  -ill  ,  58  hour. 

3  3 

y exp  (-0.09)  =  0.  91 

(b)  Twenty  vehicles  were  originally  placed  on  test  until 
the  fifth  failure.  Failed  vehicles  were  replaced  at  the  time  of  test 
Conduct  of  the  test  resulted  in  the  fifth  vehicle  failure  occurring  40 
hours  after  the  beginning  of  the  test.  Assuming  an  exponential  dis¬ 
tribution  of  failure  times,  estimate  the  population  mean  failure  time 
6  and  R(100). 


R(5)  =  exp 


( 


n  =  20 


x  =  40 

r 

r  -  5 


A 

0 


20(40) 

5 


800 

5 


]  60  hours 


F-20 


AMCP  702-3 


ft(100)  •=  exp  ( - -  X,  =  exp  (-0.  625)  =  0.  53 

\  160  y 

(3)  It  is  sometimes  desirable  to  find  a  lower  100(1  -  «)% 
confidence  limit  on  reliability  parameters.  For  the  failure  terminated 
test,  such  limits  may  be  found  for  9  and  R(x)  as  follows: 

8  > 

*  a,  2  r 


RM  i  ('X2Xr|'?I) 

where  X*a  2jjnay  be  found  in  table  H-3,  appendix  H.  In  other 
words,  we  are  100(1- «)%  confident  that  9  and  consequently  R(x)  are 
greater  than  or  equal  to  the  respective  computed  lower  limits. 

(a)  For  example,  consider  a  non- replacement  life  test 
which  is  to  be  terminated  at  the  time  of  the  3rd  failure.  Ten  widgets 
are  initially  placed  on  test.  The  resulting  failures  were  6,  8  and  20 
hours.  Assuming  an  exponential  distribution  of  failure  times,  find  a 
lower  90%  confidence  limit  for  the  population  reliability  for  a  1-hour 
mission  time. 


n  -  10 

r  =  3 

a  -  0.10 

X\,Zr  =*'  .10,6  ■  »bl.  H-3. 

Mission  time  =  1  hour 

-i-f..g±20  +  7(20)  =  ill.  =  58  hours 
3  3 

R(l)  >  exp  r  .:(l)tl0.645)  ] 

2(3)(58)  J 

R(l)  >  exp  (-.  03)  -  0.  97 
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Based  upon  the  test  data,  we  are  90%  confident  that  the  widget 
lhour’10"  reUablllty  iS  n°  le8S  than  °-  97  io r  a  mission  time  of 


^  To  exemplify  the  replacement  test,  consider  a 

faUure  Tw  Tf  is  tQ  be  terminated  at  the  time  of  the  fifth 

fifth  7  fu^  9ystemfi  were  initially  placed  on  test.  The 

Assam  °CCUr  **  40  hOUrS  fr°m  the  beein^g  of  the  test. 
Assuming  an  exponential  distribution  of  failure  times,  find  a  90% 

umit  £°' the 


n  =  20 

r  =  5 

x  =  40 

r 

«  =  0.10 

a.  Zr  =  *  in  in  =  1 5. 967  ,  table  H-3. 


1  =  exp  (-0.10)  =  0. 90 


*  V  I  *  V 


Mission  time  =  10  hours 
20(40) 


$ 


=  160 


R(10)>  exp  -(10)(15.  987) 
L  2(5)(160J 


We  are  90%  confident  that  at  least  0.  90  of  the  population  of  fuel  systems 
would  survive  a  mission  of  10  hours. 


c.  Life  tests  terminated  at  preassigned  time  T. 

(1)  Another  common  life  test  concerns  placing  of  n  items 
on  test ,  continuing  the  test  until  preassigned  termination  time  T  and 
recording  the  number  of  failures,  r,  which  have  occurred.  Such  tests 

may  be  conducted  using  either  the  replacement  or  nonreplacement 
procedure. 


* 


.F-22 


AMCP  702-3 


(2)  Point  estimates  for  6  and  R(x)  are 

a  =  T _  for  the  nonreplacement  test, 

"  In  n-ln  (n-r)  time  terminated 

£  =  nT  for  the  replacement  test, 

r  time  terminated 


for  either  type  of  time 
terminated  test 


(3)  Lower  lOOfl  -  a  )%  confidence  limit  for  0  and  R(x)  are 
2xt 


9  > 


R(x) 


a  f  2  r  +  2 


>  exp  ^  x  a  ,2 r 4-  2  ^ 


where  xt  =  x-  +  (rt-r)T  for  nonreplacement  tests 

xt  =  nT  for  replacement  tests 

It  will  be  noted  that  a  lower  confidence  limit  can  be  found  even  if  no 
failures  have  occurred.  This  is  possible  since  the  degrees  of  freedom 
are  2r  +  2. 


(4)  For  example,  consider  a  nonreplacement  life  test 
which  is  to  be  terminated  after  10  hours.  Twenty  vacuum  tubes  are 
initially  placed  on  test.  The  observed  failure  times  are  3,  5  and  9 
hours.  Find  point  estimates  of  0  and  R(l/2)  in  addition  to  a  95%  lower 
confidence  limit  for  reliability  for  a  1/2  hour  mission  time. 

r  =  3 

Xj.=  3  +  5  +  9+  17(10)  =  187  hours 

a  =0.05 

x*a,  2r+2  =  X*Q. 05,8  =  15.507 
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10 


10 


°  In  n-ln(n-r)  "In  20-ln  17  2.99573-2.83321 

R(  1  / 2)  =  exp  =  exp  (-0.008)  =  0.992 


61.5  hrs. 


R(l/2)  >  exp 


61.5 

f -(1/2)  (15.  507) 
L  2(187) 


R ( 1/2)  >  exp  (-0.  02)  =  0.  98 
F-6.  Weibull  distribution  of  failure  times. 


a.  General. 

(1)  When  the  Weibull  density  function  is  used  as  a  failure 
model,  there  are  two  parameters,  (3  and  ,  plus  the  reliability  func¬ 
tion  to  be  estimated.  The  density  function  has  been  defined  as 

'<*>  =  $  (t  [-(0s]  iotx 

f(x)  =  0  for  x  <  0 

(2)  The  methods  contained  herein  for  estimating  the  Wei- 
bull  parameters  are  concerned  only  with  nonreplacement  tests. 
Methods  for  determining  confidence  limits  for  the  Weibull  parame¬ 
ters  are  not  included. 

(3)  Two  methods  for  obtaining  point  estimates  of  P,  9 
and  R(x)  are  included;  namely,  the  method  of  matching  moments  and 
the  maximum  likelihood  method. 

b.  Method  of  matching  moments. 

(1)  If  we  conduct  a  life  test  in  which  n  randomly  selected 
items  are  placed  on  test  until  all  fail,  the  method  of  matching  mo¬ 
ments  can  be  used  to  find  point  estimates  of  the  Weibull  parameters. 
In  this  method  we  set  sample  mean  and  sample  variance  equal  to  the 
mean  and  variance  of  the  density  function  and  solve  for  the  desired 
parameters.  The  actual  operations  are: 
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let  b  =  1/p 

then 

X  --  V<b+1) 

and 

s2  =  q2  {r(2b+li  -  [r{b  +  l)]2  } 

Solving  these  yields 

n  =  5c  [r(b+l)]-1 


and 

zHzb) 

b[T(b)]2 


A 

These  equations  cannot  be  solved  for  b  (or  P).  Figure  F-ll  is  used 
to  find  values  of  b  directly  from  s2/x2.  The  relationship  P  =  b'*  is 
then  used  to  find  P  .  The  first  equation  is  then  used  to  find  t)  . 


(2)  As  an  example,  a  sample  of  3  items  was  placed  on 
test  until  all  failed.  The  failure  times  were  1,  3  and  8  hours.  Assum¬ 
ing  the  Weibull  distribution,  estimate  the  Weibull  parameters  by  the 
method  of  matching  moments, 

x  x2 

i  1 
3  9 

JS  64 

2x  =  12  74  =  Sx2 

s2/X  2  =  13/42  =  0.  8125 


Solving  for  b,  using  figure  F-ll,  we  find  b  =  0.  9.  Then 
P  =  (0.9)"1  =  1.  il 

and 


*  =  4 

11  P(l.  9) 


4.  16 
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c.  Maximum  likelihood  method.  Maximum  likelihood  esti¬ 
mates  of  the  Weibull  parameters  may  be  found  by  solving  iteratively 
the  following  equations  foi  (3  and  *  . 


F-7.  Normal  distribution  of  failure  times. 


a.  General. 


(1)  The  normal  probability  density  function  iB  sometimes 
useful  as  a  failure  model  in  reliability  analysis,  especially  when  fail¬ 
ures  are  a  result  of  wearout.  The  normal  density  function  is 


f(x) 


1 

c t\J  2t 


1  /  x-  n 

2  \  *  j 


-00  <  x  <  00 


Estimation  of  the  parameters  u  and  <r2  will  be  considered  only  for 
a  life  test  where  n  items  are  placed  on  test  until  all  fail  with  resulting 
failure  times  xj,  X£ . xn. 


b.  Then  point  estimates  of  p  ,  <r2  and  R(x)  are  respectively 


n 


f 


7 


n-1 


nSx^  -(Sx)^ 


F-27 


AMCP  702-3 


R(x)  =  P  (  Z  >  21:  2 i  \ 

\  3  J 

c.  The  100(l-a)%  confidence  intervals  for  the  two  parameters  are 


and 


5!  -t  , ,  .  ( — ^ 

»/2-n-1VN/“  J 


<  5?  +  t 


a/ 2,n-l 


(n-l)s 
2 

*  l-a/2,n-l 

where 

n  =  sample  size 


(n-l)sz  ; 
“2 -  <  Or* 

X  a/2,n-l 


n-1  =  degrees  of  freedom 


la/2,n-l  may  be  found  in  table  H-4,  appendix  H. 

X*  may  be  found  in  table  H-3,  appendix  H 

eg/  c*  i  n- 1 

d.  To  illustrate  the  estimation  of  P  and  ^  ,  consider  4 
randomly  selected  vehicles  which  have  been  tested  till  failure. 

The  failure  times  were  110,  114,  116  and  i20  hours.  Assuming  failure 
times  to  be  normally  distributed,  estimate  both  p  and  cr  by  a  point 
eetimate  and  by  a  95%  confidence  interval.  Also  find  a  point  estimate 
for  the  reliability  for  a  mission  time  of  120  hours. 


(1)  £ 

no 

114 

life 

120 


X-S  (x-*)Z 


-5 

-1 

1 

5 


25 

1 

1 

25 

52 


460 
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S  =  Si  =  460  =  U5 

n  4 

s2  r  i|W  „  52  =  n  „ 

n- 1  3 

Then  an  estimate  of  pi  is  X  =  115  and  an  estimate  of  «"  is 
s  =  Vi  7. 33  =  4.15 
(2)  For  95%  confidence,  a  =  .05. 

‘a/Z.n-l  =  *. 025,  3  '  3‘  182 

X  «/  2 ,  n  - 1  =  x  .  025,3  =  9'  348 

2  2 
X  l-«/2,n-l  x  .  975,  3  "  ' 

Then 

*  la/2,n-l  y  <  I*  <  *  +  1  a/z,  n-l  ) 

U5-3-182(tt)  4  '  U5+3182(-Tr) 

108.40  <  pi  <  121.60 

Therefore,  we  are  95%  confident  that  the  population  mean  life  is 
between  108.  40  and  121.  60  hours.  This  statement  is  dependent  upon 
the  failure  times  being  normally  distributed. 
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a^nsL  <az  <  <»-1>a2 

X  a/Z, n-1  *  l-a/Z,n-l 


3(17.  33) 

9. 348  < 


2 


<T 


< 


3(17. 33) 
.216 


5. 56  <  tZ  < 


240. 74 


2. 36  <  a  <  15.51 


Dependent  upon  the  failure  times  being  normally  distributed,  we 
are  957c  confident  that  r  is  between  2.  36  and  15.  51  hours. 

(3)  The  population  reliability  for  a  120  hour  missi-or.  time 
can  be  estimated  as 


R(120)  =  P  (  Z  >  V  P(Z  >  1.  20)  =  0.  12 

v  4.15  y 

as  found  from  table  H-2  of  appendix  H. 

Section  III.  TESTS  OF  HYPOTHESES 

F-8.  General,  a.  The  general  procedures  for  conducting  a  test  of 
hypothesis  are: 

(1)  Set  up  the  plan  format  including  the  analysis  and  deci¬ 
sion  rules. 

(a)  Determine  a  hypothesis  (H0)  to  be  tested  and  an 
alternative  hypothesis  (Hj)  which  will  be  assumed  true  if  H0  is  rejected. 
Both  hypotheses  will  pertain  to  a  particular  parameter  of  interest.  For 
illustrative  purposes,  suppose  this  parameter  is  designated  as  0  , 
Then  a  typical  set  of  hypotheses  would  be 

H0:  S  =  ®  o 

Hf:  9  <  0O 
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where  defined  as  a  specified  acceptable  (nominal)  value  of  8. 

H , :  6  <6  indicates  that  H  should  be  rejected  if  the  real  8 
1  o  n  J 

value  becomes  sigmiicantiy  less  than  6q 


(b)  Determine  a  level  of  significance,  >  ,  which  is 
defined  as  the  probability  of  rejecting  HQ  if,  in  fact,  HQ  is  true.  This 
value  provides  a  measure  of  the  sampling  risk  of  wrongly  rejecting  Hc. 

(c)  Determine  the  test  statistic,  to  be  found  from  the 
sample  data,  which  will  be  used  as  the  basis  of  the  decision  to  accept 
or  reject  H0. 


(d)  Determine  the  acceptance  region;  that  is,  those 
values  of  the  test  statistic  which  will  result  in  acceptance  oi  Ha. 

(2)  Select  the  n  sample  items  randomly  and  conduct  the 

life  test. 

(3)  Using  the  sample  life  test  results,  determine  the  test 
statistic  value. 

(4)  Compare  the  test  statistic  value  to  tne  acceptance  regio.. 
to  determine  acceptance  or  rejection  of  H0. 

b.  Ideally,  acceptance  or  rejection  of  HQ  would  be  directly 
dependent  upon  the  actual  value  of  the  parameter  0  ,  but  this  value 
would  not  be  known  short  of  100%  testing.  Consequently,  decisions 
must  be  based  on  sample  data  and  as  such  are  subject  to  two  types  of 
sampling  error.  The  first  type  is  that  of  rejecting  H0  if  H0  is  true 
and  the  second  type  is  that  of  accepting  H0  if  is  true,  [see  F-9b(3)] 

c.  The  sensitivity  or  protection  offered  by  a  test  of  hypothesis 
may  be  evaluated  by  investigating  the  probability  of  accepting  HQ  (Pa). 
Pa,  expressed  as  a  function  of  the  parameter  under  test,  is  defined 

as  the  operating  characteristic  (OC)  curve.  Even  though  the  real  para¬ 
meter  value  is  unknown,  P&  may  be  investigated  over  a  range  of 
possible  values  of  the  parameter.  Each  different  test  plan  has  its  own 
OC  curve  from  which  the  sampling  risks  may  be  evaluated. 
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d.  The  parameter  under  test  may  pertain  to  either  a  popula¬ 
tion  of  existing  material  or  a  process  for  generating  a  population  of 
material.  The  latter  would  be  useful  for  evaluating  the  state  of 
development  of  a  product. 

e.  The  discussions  which  follow  will  be  confined  to  a  few 
typical  tests  of  hypotheses  concerning  parameters  associated  with 
exponential  density  functions. 

F-  Exponential  failure  times.  a.  Reliability  is  related  to  only 
one  parameter  (  G)  when  failure  times  are  exponentially  distributed. 
Discussion  will  be  confined  to  tests  of  hypothesis  such  that  HQ  will  be 
rejected  if  9  is  too  small.  Two  basic  types  of  life  tests  will  be  con¬ 
sidered  --  the  failuie  terminated  test  and  the  time  terminated  test. 
Both  replacement  and  nonreplacement  procedures  are  included. 

b.  Life  tests  terminated  upon  the  occurrence  of  the  r1'1  failure. 

(1)  The  test  of  hypothesis  format  concerning  failure  ter¬ 
minated  tests  is  as  follows: 


Ho: 

e  = 

e 

o 

H1  : 

e  < 

a  o 

Level  of  significance: 
Test  statistic:  U 

Acceptance  region  : 


a 


where 


e 


nxr 


r 

S  Xi 
i=l  1 


for  replacement  tests 
+  (n-r)xr 


for  nonreplacement  tests 
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8Q  -  acceptable  mean  life 
r  termination  number 
n  =  sample  size 
n  >  r  for  nonreplacement  tests 
The  OC  curve  is  expressed  by 


‘  2  / 

✓  e  n 

o 

\  2 

X  2r^  ( 

v  6  , 

)  *  1  -  a ,  2  r 

(2)  To  exemplify  this  test  of  hypothesis,  a  new  vehicle  is 
under  development  and  five  prototype  models  are  available  for  testing 
to  evaluate  the  process  by  which  these  models  were  generated.  If  the 
process  is  such  that  it  has  the  capability  of  generating  items  whicv' 
have  a  mean  time  to  failure  of  0  =  100  hours  or  more,  no  further 

development  effort  is  required.  A  nonreplacement  test  is  preposed 
such  that  the  five  models  will  be  placed  on  test  until  the  third  failure 
occurs.  The  test  of  hypothesis  can  tolerate  an  a  -  .  05  risk  of  reject¬ 
ing  the  present  process  if  it  is  actually  capable  of  generating  product 
with  0  =  100  hours.  Set  up  the  test  format;  draw  the  OC  curve  for  the 

plan,  and  answer  the  question,  if  failure  times  are  20.40  and  50,  should 
the  item  be  subjected  to  further  development  ? 


(a)  Define  n,  r,  0O  and  a  as: 

n  =  5,  r  =  3,  0O=  100,  a  =  .  05 

(b)  Hq:  9  =  100  hours 
Hjt  Q  <  100  hours 
Level  of  significance:  <*  =  .  05 

*  ,S_.Xi  +{n-r)x 

Test  statistic:  0  =  x. _ 

r 


,W2*3 

5 
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F  igure 
used  to 


Acceptance  region  :  6 


>  °oX  l-«,2r  =  100  *2.  95.6 

2r  5 


100(1. 64) 

£  =  27. 3  hours 


(c)  In  order  to  evaluate  the  plan,  the  OC  cur/e  may  be  drawn 
from 


Pa  =  P[x22r  a("F')x2l-o,2 r]=P 


.  2  ^  »00<  1.64) 

x  6- - 8 - 


F-12  shows  P  for  various  va'ues  of  6  .  These  values  may  be 
sketch  the  OC^curve. 


0 

P3 

200 

0.  991 

100 

0.  95 

50 

0.  77 

25 

0.  37 

10 

0.  012 

Figure  F-12 

OC  Curve  Computations 
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_1  Computations  for  the  tabular  entries  follow. 

If  0  a  200  hours,  Pa  a  P  ^X2  i£i  ^  =  P  ^  X  >0.  82  ^  =  0.  991 
as  interpolated  from  Tahli*  H-3 

If  8  =  100  hours,  pa  =  p(  X^  >  1 . 64^  =  a  95  as  found 
in  Table  f-3. 

If  e  =  5C  hours,  Pa  -  p(x26  2-TRt)  =  p(x26  >  3.  28  )  =0.77 
as  interpolated  from  Table  H-3. 

If  6  =  25  hours,  Pa  =  P(^X26  £  =  p  (x\  >  6.  5 fc)  =0.  37 

If  0  =  10  hours,  =  P^  x26  £  TTf  )  r  P  (^X2  -  16-  *)  =0-  012 
2  Figure  F-13  represents  a  sketch  of  the  OC  curve. 


©  -  MEAN  TIME  to  FAILURE 

Figure  F-13 
OC  Curve 
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investigation  of  this  curve  over  the  range  of  potential  values  t  f  0 
provides  an  evaluation  of  the  proposed  plan  in  terms  of  the  protec  ¬ 
tion  offered.  This  evaluation  may  be  performed  prior  to  the  dccieiei. 
to  use  the  plan. 


(d)  X!  =  20  ,  x2  =  40  ,  X3  =  50 

ft  =  -I1Q  +  Zm _  =  _210_  =  70 

3  3 

Since  0  >  27.  3,  accept  the  hypothesis  that  0  -  100  hours  and  con¬ 

clude  that  on  the  basis  of  these  test  results  no  further  development  is 
required. 


(3)  Inspection  of  the  Pa  function  indicates  that  the  number 
of  failures  (r),  and  not  the  sample  size,  determines  the  degree  of  pro¬ 
tection  offered.  The  preceding  example  specified  that  the  test  will  be 
stopped  upon  occurrence  of  the  third  failure  and  that  the  test  includes 
a  risk  of  «  =  .  05  of  rejecting  H0  if  HQ  is  actually  true.  If  more  rigid 
protection  requirements  were  specified,  the  test  termination  number 
must  be  increased,  i.e.,  testing  must  proceed  until  more  fr-i  lores  have 
occurred. 


(4)  A  test  may  be  determined  which  will  meet  the  following 
requirements  for  protection  (i.  e.  ,  required  r  value  is  determined). 

(a)  If  the  true  mean  failure  time  (  0  )  is  equal  to  a 
specified  nominal  value  (  0  c  )>  the  test  should  allow  an  a  probability 
of  rejecting  the  lot  (process). 

(b)  If  the  true  mean  failure  time  (  0  )  is  equal  to  a 
specified  minimum  value  (0.  ),  the  test  should  allow  a  3  probability 
of  accepting  the  lot  (process),  where  0O  >  0^, 

In  other  words,  the  test  must  be  such  that  its  OC  curve  will  pass 
through  the  points  (Gq  ,  l-a-)  and  (0.  ,  3  ).  The  required  value  of  r 
may  be  found  from  the  following  relationship. 

X  l-«,  2r  61 

The  relationship  applies  to  either  replacement  or  nonreplacement  tests. 
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(5)  To  illustrate  the  above  requirement,  consider  a  lot 
cf  components  which  is  being  considered  for  use  in  a  weapons  system. 
Assume  the  failure  times  of  these  components  to  be  exponentially  dis¬ 
tributed.  Formulate  a  nonreplacement  failure  terminated  test  which 
would  accept  the  lot  with  probability  0.  95  if  its  true  mean  life  is  500 
hours  and  which  would  accept  the  lot  with  probability  0.  10  if  its  true 
mean  life  is  200  hours. 


(a) 

(b) 


Define : 

0O  =  500,  -  200,  a  -  0,  05, 

Test  format: 


Ho  : 

6 

=  SCO 

H1  : 

G 

<  500 

Level 

of 

significance  : 

$ 

II 

o 

r 


Test  statistic  : 


^  ifixiMn-r)xr 


3 


Acceptance  region 


r 


/N 

e 


> 


e 


XV«t2r 

2  r 


0. 10 


500 


95. 2r 


2  r 


(c)  The  required  value  of  r  must  be  such  that  the 
following  relationship  is  satisfied. 


X  .  10 , 2  r 

T  — 

X  .  95,  2r 


= 

X  l-cr,2r 


500 


=  2.5 


Solution  of  this  equation  may  be  obtained  by  trying  different  values  of 
r  until  the  ratio  of  x*  values  is  equal  to  2,  5.  Figure  F-14  shows  an 
iterative  method  for  determining  r. 
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Trial 
Value 
of  r 

2 

X  .  10, 2r 

xZ.  95,2  r 

2 

x  .  10, 2r 

2 

X  .  95, 2r 

1 

4.  61 

.  103 

44.  8 

5 

15.  99 

3.  94 

4.  1 

7 

21. 06 

6.  57 

3.  2 

10 

28.  41 

10.85 

2.  6 

11 

30.  81 

12.  34 

2.  49 

12 

33.  20 

13.  85 

2.  39 

13 

35.  56 

15.  38 

2.31 

Figure  F-14 

Determination  of  Termination  Failure  Number 

(d)  Thus,  in  order  to  meet  the  stated  requirements, 
the  test  should  be  terminated  upon  occurrence  of  the  1  lthfailure  and 
consequently,  the  sample  size  can  be  no  less  than  11.  Acceptance  of 
Ho  for  this  test  yields  90%  confidence  that  0  >  200  hours. 

c.  Life  tests  terminated  at  a  preaseigned  time  T. 

(1)  The  test  of  hypothesis  format  concerning  time  ter¬ 
minated  tests  is  as  follows: 

h0  :  e  =  e0 

H1  :  0  <  0O 

Level  of  significance  :  a 

Test  statistic:  r  -  number  of  failures  occurring 
during  test 
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Acceptance  region  :  r  <  r[},  where  rp  is  a  rejection 

number  which  must  satisfy  the 
relationship 


V(*r) 


exp 

TT" 


(  -“T  "l 
-  o  ' 


1-a  for  a  replacement  test 


k=0 


zo'1 


Z(k)  [  ,-x«,(-*r)]  h  (v)] 


n  -k 


=  1  -  a 


k=0 


for  a  nonreplacemeni  test. 

(2)  The  OC  carve  lor  the  time  te~imnated  test  depends 
upon  whether  the  teat  is  replacement  or  nonreplacement. 


(a)  The  Poisson  distribution  is  used  to  express 
probability  of  acceptance  for  replacement  teats. 


P  =  P(r 

rt 


<  r. 


L. 

k-0 


(•  nT  ^ 

exp  —  j 


(b)  The  nonreplacement  test  uses  the  binomial  distribu¬ 
tion  to  express  Pa. 


P 

a 


P(r  <  rQ) 


r  -1 


k-0 
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(3)  Four  prototype  developmental  helicopter  models  are 
available  for  testing  to  determine  if  the  present  developmental  process 
is  capable  of  generating  items  with  a  mean  time  between  failures  (MTBP') 
of  at  least  100  hours.  The  decision  to  accept  or  reject  the  developmental 
process  is  needed  within  10  hours  and  a  5%  risk  of  rejecting,  if  the  true 
MTBF  is  100  hours,  can  be  tolerated.  Set  up  a  nonreplacement  test 
format;  sketch  the  OC  curve  for  this  test;  and  answer  the  question; 

Should  the  development  procedure  be  accepted  if  3  failures  are  encoun¬ 
tered  during  conduct  of  the  test? 

(a)  Define: 

T  =  10,  0O  =  100,  a  =  .  05,  n  =  4 
(.b)  Test  format: 


H0 

e  = 

100 

H1  : 

e  < 

100 

a  - 

.  05 

lest  statistic:  r  -  number  of  failures  found  during 
test 

Acceptance  region  :  r  <  r  where  r  must  satisfy 
*  °  o  o 

the  following  relationship: 


ro-1 


V  f  <  ~\ 

Z  u; 

k-0 


(- 10 
1  -  exP  IjCS 


nk 


/'-10\'l4-k 

exP'sJWj]  ^  L\kf 


ZAk 

k=0 


1)  '..9) 


4-  k 


This  relationship  is  approximately  satisfied  by  rQ  =  2,  Exact 
satisfaction  may  be  impossible  because  of  the  discrete  characteristics 
of  r  . 


o 


95 
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(c)  Some  coordinates  for  sketching  the  OC  curve  are 
calculated  below  (binomial  tables  may  be  used  in  lieu  of  these  cal¬ 
culations). 


P 

a 


/ 4 

vk 


k-0 


r  /-io\ 

L 


T  Aio  \  1 

.expV~/J 


4-k 


For  8  =  100  hours,  exp  ^  =  exp  (-0.  1 )  =  0.  9 

P_  =  (0.  9)4  +  4(0.  1 ) (0.  9)3  =  0.  66  +  0.  29  =  0.  99 


For  9  =  200  hours,  exp 


A  10  N 


exo  (0.  05)  -  0.  95 


Pa  =  (0.  95)4  +  4(0.  05)(0.  95)3  =0.81  +  0.  17  =  0.  98 


-/-10  N 

For  8  =  50  hours,  exp  j  -  exp  (-0.  2)  =  0.  82 


P,  =  (0.  82 ) 4  +  4(0.  1 8) (0 .  82 ) 3  =  0.  45  +  0.40  =  0.85 


10  \ 


F cr  8  =  25  hours,  exp  (  — j  -  exp  (-0.4)  =  0.  67 


P,  =  (0.  67 ) 4  +  4(0.  33)(0.  67)3  =  0.  20  +  0.  40  =  0.60 


A  10 


For  0  =  10  hours,  exp  j  ~  exP  (- 1 )  -  0.  37 


P  =  (0.  37)4  +  4(0.  63)(0.  37) 3  =  0.  02  +  0.  13  =  0.  15 


F-41 


1 


AMCP  702-3 

For  6  =  5  hours,  exp  ^  ^  =  exp  (-  2)  =  C.  14 

Fa  =  (0. 14)4  +  4(0.  86)(0.  14)3  =  0.  0004  +  0.  009  --  0.  0094 

From  these  points,  the  OC  curve  is  sketched  as  Figure  F-15. 


0  40  80  120  160  200 


■4 

A,  0  -  Mean  Time  to  Failure 


Figure  F-15 
OC  Curve 

(d)  If  3  failures  were  encountered  during  the  10  hour 
test,  H0  would  be  rejected  indicating  that  there  is  reason  to  believe 
the  mean  failure  time  to  be  less  than  100  hours  and  development  acti¬ 
vities  should  continue.  Since  rQ  =  2  is  a  rejection  number,  the  test 
could  have  been  terminated  when  the  2n^  failure  occurred. 
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(4)  Inspection.  of  the  Pa  functions  for  a  time  terminated 
test  shows  that  sample  size  contributes  to  the  degree  of  protection 
offered  for  a  specified  termination  time  T.  The  required  sample  size 
and  rejection  number  may  be  found  if  the  following  test  requirements 
are  specified. 


(a)  Test  termination  time  (T). 

(b)  A  lot  (process)  with  9  =  8  would  have  a(l-o) 
probability  of  being  accepted. 

(c)  A  lot  (process)  with  9  =  G  ^  would  have  a  9  proba¬ 
bility  of  being  accepted. 

The  required  sample  size  and  rejection  number  mast  satisfy  the  fol¬ 
lowing  relationships.  For  a  replacement  test: 


k=0 


For  a  nonreplacement  test 

1  -  exp 


■■o-1 


I  (0  [l— p(-v)]  [<*P  (-TT-). 


and 


k=0 


ro-1 


n-k 


1  -a 


1(0  [ 1  - cxp ( -if- ) ]  ['xp('v)] 

k=0 
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These  determinations  may  be  made  by  trying  different  values  of  rQ 
and  n  until  the  equations  are  satisfied.  Figure  H-12  in  appendix  H 
may  be  used  for  the  replacement  teat  determinations.  Binomial  tables 
would  facilitate  the  nonreplacement  test  determinations, 

d.  Sequential  tests. 

(1)  Often  times  a  decision  concerning  acceptance  or 
rejection  of  H0  can  be  reached  more  quickly  by  applying  a  sequential 
decision  procedure.  A  sequential  test  involves  a  set  of  rules  to  be 
applied  each  time  a  failure  occurs  (theoretically  applied  continuously 
over  time.)  The  decision  will  be  one  of  these:  Accept  Ho  and  stop  the 
test,  reject  HQ  and  stop  the  test,  or  continue  testing.  The  test  would 
continue  until  a  decision  to  accept  H0  or  reject  H0  is  reached. 

(2)  The  tests  discussed  herein  are  determined  by  applying 
Wald's  probability  ratio  test  to  an  exponential  distribution  of  failure 
times.  The  test  procedure  will  be  designed  to  test  the  following  set  of 
hypotheses: 


Ho  :  0  =  9o 

Hi  :  0  <8o 

(3)  In  order  to  design  a  test,  the  following  requirements 
must  be  specified. 

(a)  Determine  an  acceptable  mean  life  0Q. 

(b)  Determine  the  magnitude  of  an  a  risk  which  may 
be  tolerated,  where  ot  is  the  probability  of  rejecting  H0  if  the  popula¬ 
tion  mean  life  0  =  0Q. 

(c)  Determine  an  unacceptable  or  limiting  mean  life 

where  <  0O. 

(d)  Determine  the  magnitude  of  a  3  risk  which  may  be 
tolerated,  where  3  is  the  probability  of  accepting  H0  if  0  =  0^. 
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(4)  The  protection  offered  by  the  test  may  be  evaluated  by 
examining  ity  operating  characteristic  (OC)  curve.  Another  factor 
which  is  of  importance  in  selecting  a  plan  is  the  expected  duration  of 
the  test,  i.e.  ,  how  long  must  we  wait  for  the  decision? 

(5)  The  sequential  decision  criteria  are: 


If  hj  +  k  s  <  V(t)  <  h„  +  k  s,  continue  the  teat. 
If  V(t)  >  hc  +  k  s,  stop  the  teat  and  accept  HQ  . 
If  V(t)  <  hj  +  k  s,  stop  the  test  and  reject  Hq  . 
where 


V(t)  =  nt  for  a  replacement  test 
k 

V(t)  =  S  +  (n-k)t  for  a  non-replacement  test 
i  =  1 

t  is  the  test  duration  time 
n  is  the  original  number  placed  on  test 

xi  i®  the  time  of  the  ith  failure  measured  from  test  beginning 
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(6)  This  sequential  procedure  may  be  applied  at  any  point 
in  time  but  must  be  applied  at  least  upon  the  occurrence  of  each  failure. 
Graphically,  these  decision  rules  appear  as  shown  by  figure  F-16. 


Figure  F-16 

Graphical  Decision  Rules  of  the  Sequential  Test 

(7)  The  OC  curve  coordinates  may  be  found  by  letting  the 
parameter  h  run  through  all  real  values  in  the  following  parametric 
equations. 


0  = 


Pa  = 


b(v  i) 
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Figure  F-17  shows  five  points  which  are  easily  found  and  enable  us  to 
sketch  the  OC  curve. 


0 

Pa 

0 

0 

61 

0 

S 

-  (¥) 

*■  (¥)-*■  (&) 

9 

1  -  a 

<30 

1 

Figure  F-17 

Coordinates  for  Sketching  Sequential  Test  OC  Curve 

(8)  The  expected  number  of  failures  required  to  reach  a 
decision,  Egfr),  is  dependent  upon  the  lot  mean  life  9  and  may  be 
found  as  follows: 


E.I'I  = 


-h  -  <Vhl»  Ps 


S  -  0 


0^8 


E  q  (r ) 


-h  h, 

o  1 


B 


e=8 


where  the  random  variable  r  is  the  number  of  failures  required 
to  reach  a  decision.  The  approximate  values  of  E  _  (r)  if 
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6  =0,dj,s,-®  i  or  "  reduce  to 


E0(r)  = 


E  0^ 


Es(r) 


En  (r)  ~ 


?ln  (■&)  +  <1'I!U“  (is6) 

*(V  ■('■&' 
-*  (¥)  -  (£) 

>"2  fr) 

ll-a.'to  *  «ln  (~) 

/  e„  \  /  o  N 

ln  (v  )  ’(“fff  ’  1  ) 


E  (r)  =  0 


(9)  The  expected  waiting  time  to  reach  a  decision,  E  g  (t), 
is  a  function  of  9  and  is  found  by  : 

E  6  (t)  =  JL  Eq  (r)  tor  a  replacement  test 
n 

and  approximately 

Ea{t)  "0  In  - 2 _  for  a  nonreplacement  test 

L  n-Ee  (r)  J 

hn 

For  either  case,  0  -  »  -  educes  to  E  (t)  -  - 

00  n 
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(10)  As  Burning  the  exponential  distribution,  develop  a 
sequential  replacement  test  which  would  accept  a  submitted  lot  of 
material,  with  probability  0.95,  if  its  mean  life  is  1500  hours  and 
which  would  reject  a  submitted  lot,  with  probability  0.  90,  if  its  mean 
life  is  300  hours.  Twenty  items  are  to  be  placed  on  test.  Calculate 
the  decision  rules;  sketch  the  OC  curve;  sketch,  as  a  function  of  6  , 
a  curve  showing  the  expected  number  of  failures  to  be  encountered 
before  a  decision  of  acceptance  or  rejection  is  reached;  sketch  a  curve 
showing  the  expected  test  duration  time  as  a  function  of  8  ;  and  if 
failures  were  encountered  at  the  following  times,  should  the  lot  be 
accepted?  (Use  only  as  many  as  needed  to  reach  a  decision.  ) 


x^  =  12,  x?  =  100,  x^  -  140,  x,j  =  206 
(a)  Define  and  calculate: 


0  „  =  1500,  a  *  0.05 
0  ,  «  300,  6  *  0.10 
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-2.891 

“1/375 


=  -1084.1 


1.609  _ 

T7TT?  ‘ 


603.  4 


If  -1084.  1  +  603.  4k  <  nt  <  844.  5  +  603.  4k,  continue  the  test. 

If  nt  >  844.  5  +  603.  4k,  stop  the  tect  and  accept  the  lot. 

If  nt  <.  -1084,  1  +  603.  4k,  stop  the  test  and  reject  the  lot. 

(b)  The  OC  curve  may  be  sketched  from  points  shown  in 
figure  F-18  and  the  sketch  as  shown  in  figure  F-19. 


e 

p 

a 

0 

0 

0J  =  300 

0  =0.  10 

8  =  603. 4 

m  (±di) 

\  °  /  2.891 

2'8,,  +  "2”  'J 

e  =  lsoo 

o 

1-0  -0.95 

m 

1 

Figure  F-18 

Coordinates  for  Sketching  Sequential  OC  Curve 
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Figure  F-19 

Sketch  of  Sequential  QC  Curve 
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Figure  F-20 

Coordinates  for  Sketching  Expected  Number  of  Failure  Curve 
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(c)  The  expected  number  of  failures  curve  may  be 
sketched  from  the  points  in  figure  F-20  and  the  resulting  sketch 
shown  by  figure  F-2  1. 


Figure  F-21 

Sketch  of  Expected  Number  of  Failures  Curve 


(d)  The  expected  test  duration  time  curve  may  be 
sketched  from  the  points  in  figure  F-22  and  tne  resulting  sketch 
shown  in  figure  F-23. 
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(e)  Figure  F-24  shows  graphically  the  sequential  decision 
criteria  for  this  teBt.  The  cumulative  nt  line  crosses  into  the  acceptance 
region  before  the  second  failure  occurs.  Consequently,  accept  HQ  and  the 
test  should  be  stopped  at  the  time  the  nt  value  crosses  the  acceptance  line 
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(11)  The  primary  advantage  of  sequential  testing  is  that, 
on  the  average,  less  testing  is  required.  Some  important  disadvan¬ 
tages  of  sequential  testing  are  as  follows: 

(a)  The  exact  amount  of  testing  is  not  specified  in 
advance  with  the  result  that  planning  and  budgeting  problems  may 
develop. 


(b)  The  greatest  amount  of  testing  is  required  if  the 
value  of  B  lies  in  the  zone  of  indifference  between  9  ^  and  ©  0 . 

(c)  The  required  record  keeping  becomes  more  complex. 

F-10.  Weibull  failure  times.  The  Weibull  distribution  depends  upon 
two  parameters  ,3  and  u  .  Tests  of  hypotheses  concerning  these  para¬ 
meters  are  rather  complex  and  will  not  be  discussed  herein.  However, 
there  are  government  sampling  tables  pertaining  to  the  Weibull  distri¬ 
bution. 

F-ll.  Normal  failure  times.  Tests  of  hypotheses  may  be  applied  to 
the  parameters  \i  and  <r  ,  of  the  normal  distribution.  However,  these 
tests  are  found  in  numerous  elementary  statistics  textbooks  and  will 
not  be  discussed  herein. 

Section  IV.  ACCEPTANCE  LIFE  TESTING 

F-12.  General,  a.  The  precedinp.  tests  were  concerned  wiih  testing 
of  hypothesis  aDout  reliability  and  reliability  related  parameters.  This 
type  of  test,  when  used  as  a  basis  for  accepting  material,  is  sometimes 
referred  to  as  an  acceptance  life  test.  There  are  a  number  of  govern¬ 
ment  documents  which  contain  tables  of  test  plans  which  were  calculated 
using  tests  of  hypothesis  similar  to  those  already  discussed.  These  will 
be  discussed  under  the  title  of  acceptance  life  tests. 

b.  Tables  are  available  for  different  failure  time  models.  Those 
to  be  discussed  herein  will  include  the  exponential  distribution,  Weibull 
distribution  and  normal  distribution,  as  well  as  nonparametric  tables 
Since  these  documents  are  self-explanatory  and  include  examples,  the 
contents  will  only  be  summarized. 
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F-13.  Exponential  failure  times. 


a.  DoD  Quality  Control  and  Reliability  Handbook  HI 08, 

Sampling  Procedures  and  Tables  for  Life  and  Reliability  Testing 
(Based  on  the  Exponential  Distribution)  contains  tables  of  life  testing 
sampling  plans  pertaining  to  exponential  failure  times.  The  plans 
are  divided  into  three  general  categories:  failure  terminated  tests, 
time  terminated  tests  and  sequential  tests.  The  mean  failure  time  8 
is  used  as  the  reliability  parameter  under  test.  Minimal  and  nominal 
acceptable  values  of  e,  along  with  allowable  risks,  are  used  as  the 
basis  for  specifying  a  satisfactory  sampling  plan. 

b.  The  sequential  test  procedures  are  outlined  and  the  para¬ 
meters  of  the  test  are  tabled.  The  formulas  of  paragraph  F -9d  of 
this  appendix  may  be  used  for  expanding  these  tables. 

c.  Operating  characteristic  curves  are  drawn  for  most  tabled 
plans.  The  methods  in  paragraph  F -9  of  this  appendix  may  be  used  for 
constructing  OC  curves  which  are  not  included. 

F-14.  Weibull  failure  times.  A  series  of  technical  reports  contain 
tabled  sampling  plans  when  failure  times  are  distributed  in  accordance 
with  a  Weibull  distribution.  Each  is  dependent  upon  a  known  P parameter 

a.  JOD  Quality  Control  and  Reliability  Technical  Report  TR-3,* 
Sampling  Procedures  and  Tables  for  Life  and  Reliability  Testing  Based 
on  the  Weibull  Distribution,  (Mean  Life  Criterion)  provides  tabled 
plans  when  mean  failure  time  is  the  reliability  parameter  to  be  tested. 

b.  DOD  Quality  Control  and  Reliability  Technical  Report  TR-4,^ 
Sampling  Procedures  and  Tables  for  Life  and  Reliability  Testing  Based 
on  the  Weibull  Distribution  (Hazard  Rate  Criterion)  provides  tabled 
plans  when  hazard  rate  or  instantaneous  failure  rate  is  the  parameter 
under  test. 


c.  DOD  Quality  Control  and  Reliability  Technical  Report  TR-6,* 
Sampling  Procedures  and  Tables  for  Life  and  Reliability  Testing  Based 
on  the  Weibull  Distribution  (Reliable  Life  Criterion)  provides  plans  when 
reliable  life  is  the  parameter  under  test.  Reliable  life  is  defined  as  that 
time  beyond  which  a  specified  portion  of  a  lot  can  be  expected  to  survive. 


d.  DOD  Quality  and  Reliability  Assurance  Technical  Report 
TR - 7 ,  ^Factors  and  Procedures  for  Applying  MIL-STD-105D  Sampling 
Plans  to  Life  and  Reliability  Testing,  provides  instructions  for  selecting 
life  test  sampling  plans  from  MIL-STD- 105D. 


^These  reports  may  be  secured  from  the  Superintendent  of  Documents. 
U.S.  Government  Printing  Office,  Washington,  D.C.  20402. 
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F-15,  Normal  failure  timas. 


a.  If  failure  times  are  known  to  be  normally  distributed,  a 
life  test  sampling  plan  may  be  found  from  MIL-STD-414,  Sampling 
Procedures  and  Tables  for  Inspection  by  Variables  for  Percent  De¬ 
fective.  As  indicated  by  the  title,  MIL-STD-414  expresses  confor¬ 
mance  as  percent  defective,  i.  e.  ,  the  percent  of  the  iten:  *  falling 
outside  specification  limits.  In  the  case  of  life  testing,  c  mformance 
may  be  expressed  as  the  percent  of  items  failing  prior  to  a  specified 
time. 


b.  A  life  test  sampling  plan  from  MIL-STD-414  would  require 
that  all  sample  items  be  tested  until  failure.  The  resulting  failure 
times  may  then  be  symbolized  &>  xj,  xj,  ...  ,  xn,  A  sampling  plan 
consists  of  two  parameters  --  sample  size  (n)  and  maximum  allow¬ 
able  percent  defective  (M)  --  and  may  be  obtained  if  an  AQL*  inspection 
level,  degree  of  inspection,  and  lot  size  are  specified.  The  first  step 
is  to  find  a  code  letter  in  table  A-2  by  using  the  lot  size  and  inspec¬ 
tion  level.  If  normal  or  tightened  inspection  are  to  be  used,  enter 
table  B-3  with  AQL  and  code  letter  to  find  n  and  M.  For  reduced  in¬ 
spection,  table  B-4  is  to  be  used. 

c.  The  procedures  of  analyzing  the  sample  data  and  deciding 
upon  lot  acceptance  is  summarized  in  the  following  steps. 

m  Compute  the  sample  mean  X  • 

'  '  n 

(2)  Compute  the  sample  standard  deviation 

nSx2  -  (Sx)2 
n(n-l) 

(3)  Calculate  the  quality  index 


Ql  = 


X  -  L 


s 


where  L  is  a  lower  specification  limit  {specified  time)  and 
where  QL  is  the  quality  index  associated  with  L. 
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(4)  Enter  table  B-5  with  and  n  to  find  the  estimated 

lot  percent  defective  (p^,)  associated  with  the  lower  specification  limit. 

(5)  The  decision  rules  are  as  follows: 

(a)  If  p^  <  M,  accept  the  lot 

(b)  If  p  >  M,  reject  the  lot 

d.  To  illustrate  the  selection  of  a  life  test  sampling  plan  from 
MIL-STD-414,  consider  a  lot  of  60  components  which  has  been  submitted 
for  acceptance  relative  to  life  characteristics.  The  failure  times  are 
known  from  past  experience  to  be  normally  distributed.  A  life  test 
sampling  plan  is  to  be  selected  from  MIL-STD-414  using  inspection 
level  III,  normal  inspection,  variability  unknown  -  standard  deviation 
method,  single  specification  limit  and  form  2. 

(1)  Find  the  sampling  plan,  n  and  M,  such  that  if  the  lot 
has  a  reliability  of  0-  975for  a  35  hour  mission  time,  R(35)  =  0.  975, 
the  probability  of  acceptance  would  be  high. 

(2)  If  the  submitted  lot  has  R{35)  -  0.  90  what  is  its  prob¬ 
ability  of  being  accepted? 

(3)  Using  the  plan  found  in  part(l),  the  failure  times  were 
as  follows:  34,  38,  47,  51,  55,  59  %nd  62  hours  (use  only  as  many  as 
required  in  the  sampling  plan).  D<  ermine  whether  the  lot  should  be 
accepted. 


e.  The  solutionis  as  follows: 

(1)  An  AQL  of  2.  5%  defective  for  a  lower  specification 
limit  L  =  35  hours  would  correspond  with  R(35)  =  0.  975. 

(a)  Using  a  lot  size  of  60  and  inspection  level  III, 
table  A-2  yields  code  letter  C, 

(b)  Using  code  letter  C  and  AQL  =  2.  5%,  table  B-3 
yields  n  =  4  and  M  =  10.  92. 
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(2)  Find  the  OC  curve  which  is  shown  for  code  letter  C 
and  AQL  =  2.  5%  on  page  7.  For  a  lot  with  R{35)  0.  90  (i.  e.  ,  10% 

failing  before  35  hours)  tl ,  s  OC  curve  shows  a  probability  of  accep¬ 
tance  of  62%. 


47,  51. 


(3)  Since  n  =  4,  the  resulting  failure  times  were  34,  38, 


X 

x6 

34 

1156 

38 

1444 

47 

2209 

_51_ 

2601 

170 

7410 

(a) 

(b) 

(c) 


"  I  nS  *2  -  =  /  4(7410)  -  (170)'*  ? 

V  n(n-l)  V  4(3) 


n(n-l) 

Qr  =  JLJ± 


85 


42.  5  -  35  e 
7.  85 


0-  96 


(d)  Using  Ql  =0.  96  and  n  =  4,  Table  B-5  yields  an  estimated 
percent  defective  p^  *  18.00, 

(e)  Since  pj^  =  18.  00  >  M  =  10.  92,  the  lot  is  rejected,  and 
conclude  that  the  reliability  of  the  lot  is  too  low. 

F-16.  Nonparametric  sampling  plans. 

a.  M1L-STD-105D,  Sampling  Procedures  and  Tables  for 
Inspection  By  Attributes,  provides  sampling  plans  relative  to  attributes 
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inspection.  Attributes  inspection  is  inspection  whereby  either  the 
unit  of  product  is  classified  simply  as  defective  or  nondefective,  or 
the  number  of  defects  in  the  unit  is  counted,  with  respect  to  a  given 
requirement  or  set  of  requirements.  Thus,  conformance  can  be 
expressed  in  terms  of  percent  defective  or  defects  per  hundred  units. 
For  reliability  testing  purposes,  we  fhall  be  concerned  with  percent 
defective. 

b.  These  procedures  apply  directly  to  one  shot  items,  i.e., 
those  for  which  failures  do  not  depend  on  time.  However,  these 
sampling  plans  may  also  be  applied  to  life  testB  even  if  the  distribu¬ 
tion  of  failure  times  is  unknown.  In  this  case  a  defective  item  would 
be  defined  as  an  item  which  failed  prior  to  a  specified  time  t.  Such 
a  life  test  must  be  nonreplacement  and  must  be  terminated  at  t. 

c.  A  sampling  plan  may  be  found  from  MIL-STD-105D  if  the 
lot  size,  inspection  level,  AQL,  degree  of  inspection,  and  type  of 
sampling  are  specified.  The  initial  step  is  to  find  a  code  letter  in 
table  I  using  lot  size  and  inspection  level.  If  either  normal  or  tightened 
inspection  is  specified,  enter  table  X  with  the  code  letter  and  AQL  to 
find  the  sampling  plan.  If  reduced  inspection  is  in  effect,  find  the  plan 
in  table  II-C  for  single  sampling. 


d.  The  single  sampling  plan  consists  of  a  sample  size  (n),  and 
acceptance  number  (Ac)  and  rejection  number  (Re).  The  lot  is  to  be 
accepted  if  the  number  of  defectives  found  in  the  sample  does  not  exceed 
the  acceptance  number.  The  lot  is  to  be  rejected  if  the  number  of  sam¬ 
ple  defectives  is  equal  to  or  greater  than  the  rejection  number. 

e.  For  example,  a  lot  of  125  components  has  been  submitted 
for  acceptance  with  respect  to  life  characteristics.  The  distribution 
of  failure  times  is  unknown.  A  nonreplacement  life  test  sampling  plan 
is  to  be  selected  from  MIL-STD-105D  using  inspection  level  IH,  normal 
inspection  and  single  sampling. 

(1)  Find  a  sampling  plan  such  that  the  probability  of  accep¬ 
tance  will  be  high  if  reliability  for  a  10  hour  mission  time  is  0.  96. 

(2)  If  the  submitted  lot  has  R(10)  =  0.  92,  what  is  its 
probability  of  its  being  accepted  if  this  plan  is  used? 
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(3)  A  sample  of  the  size  found  in  part  1  was  subjected  to 
test  and  2  items  failed  prior  to  the  10  hour  termination  time.  Should 
the  lot  be  accepted? 

f.  The  solution  follows: 

(1)  The  life  test  is  to  be  terminated  at  10  hours.  Then  an 
AQL  oi  4%  would  correspond  to  R(10)  =  0.9b.  The  sampling  plan  is 
found  as  follows: 

(a)  For  a  lot  size  of  125  and  inspection  level  III, 
table  I  yields  code  letter  G. 

(b)  For  code  letter  G,  AQL  -  4.  0,  normal  inspection 
and  single  sampling,  table  X-G-2  indicates  a  sampling  plan  of  n  -  32, 

Ac  -  3  and  Re  -  4. 

(2)  Find  the  OC  curve  for  code  letter  G  and  AQL  =  4.  0 

in  chart  G.  For  a  lot  with  R(10)  -  0.92  (i.e.  ,  8%  failing  before  10  hours) 
this  OC  curve  indicates  a  74%  probability  of  acceptance. 

(3)  Of  the  32  sample  items,  2  failed  before  test  termination 
time  of  10  hours.  Since  the  numbc-  of  failures  did  not  exceed  the  accep¬ 
tance  number,  the  lot  should  he  accepted  because  its  reliability  is  high 
enough. 

Section  V.  REGRESSION  ANALYSIS 

F-17,  General,  a.  A  major  problem  during  the  research  and  develop¬ 
ment  of  an  equipment  is  the  assurance  of  high  functioning  reliability  of 
the  final  prototype  model.  Reliability  analysis  sometimes  involves  the 
determination  of  some  reliability  parameter  for  various  known  stress 
levels  err  design  characteristics;  for  example,  determination  of  the  mean 
time  to  failure  at  different  levels  of  stress,  determination  of  the  bursting 
pressure  for  different  wall  thicknesses  of  rocket  motors,  determination 
of  vehicle  fuel  usage  at  different  velocity  levels,  etc.  Such  determina¬ 
tions  are  sometimes  useful  for  evaluating  equipment  design,  identifying 
trouble  areas  and  potential  corrective  activities,  etc. 

b.  Regression  analysis,  applied  to  experimental  data,  may  be 
used  to  provide  information  concerning  the  relationship  between  a 
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response  (dependent)  variable  and  vaiiouB  levels  of  an  independent 
variable(s). 

F-18.  Simple  Linear  Regression. 

a.  The  simplest  form  of  regression  involves  determination 
of  the  expected  value  of  the  response  or  dependent  variable  from  in¬ 
formation  concerning  the  independent  variable  value.  Herein,  we 
shall  discuss  simple  linear  regression  where  the  expected  response  is 
a  linear  function  of  the  independent  variable.  The  regression  model  is 

p  y<  x  *  A  +  Bx 

where 

p  y  x  s  expected  response  associated  with  x 
A  and  B  are  parameters  of  the  model 


b.  The  parameter  B  indicates  the  amount  of  change  in  y  which 
can  be  attributed  to  a  unit  change  in  x,  i.  e.  ,  the  slope  of  the  line.  A 
is  the  value  of  p  „  „  evaluated  at  x  -  0. 

7  •  x 


c.  Since  A  and  B  are  parameters,  they  may  be  estimated  by 
analyzing  n  observations  of  paired  values  of  (xj,  y^)  where  i  =  1,  2,  ...  , 
n.  The  regression  equation  for  estimating  the  expected  response  is 

y  =  a  +  bx 

where 

-  SxSxy 

a  =  —  — .  -*■  — — ~ - is  an  estimate  of  A 

nSx2  -  (Exp 


b 


n^xy  -  SxZy 
n2x2  -  (  2x)2 


is  an  estimate  of  B 


and 


$  is 


an  estimate  of  n  „  v 
y  • A 
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d.  To  illustrate  the  use  of  regression  analysis  techniques, 
suppose  the  data  shown  in  figure  F-25  represents  observations  of  the 
bursting  pressure  and  wall  thickness  of  a  sample  of  three  rocket 
motors. 


y,  Bursting  Pressure 

x,  Thickness 

(dynes  /cm^) 

(mm.  ) 

10,000 

1 

23,  000 

2 

30,  000 

3 

Figure  F-25 

Observations  of  Rocket  Motor  Wall  Thickness  and  Bursting 

Pressure 

(1)  Determine  the  sample  regression  line,  plot  a 
scattergram  of  the  paired  observations,  and  draw  the  line. 

(2)  Estimate  the  effect  on  bursting  pressure  of  adding 

1  mm.  to  the  wall  thickness  by  both  a  point  estimate  and  a  90%  confi¬ 
dence  interval. 

(3)  A  proposed  motor  must  have  an  average  bursting 
pressure  of  25,  000  dynes  per/cm^.  What  wall  thickness  should  be 
used  in  the  design? 

(4)  Using  the  wall  thickness  found  in  part  c,  estimate  both 
the  average  bursting  pressure  and  the  bursting  pressure  of  an  individual 
motor  by  a  90%  confidence  interval. 

e.  The  solution  follows: 

n  =  3 
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JL 

X 

£ 

JSL 

_£L 

10000 

i 

1 

10000 

100000000 

23000 
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4 

46000 

529000000 

30000 

3 

9 

90000 

900000000 

63000 

6 

14 

146000 

1529000000 

£  y 

Ex 

£x2 

Exy 

2y2 

(1)  a  = 

14(63000)  - 

6(146000)  „  6000 

=  1000 

3(14)  -  (6)2 


b  -  3(146000)  -  6(63000)  _  60000  _  l()000 
3(14)  -  (6)2  6 

Then,  the  sample  regression,  line  is 
y  =  1000  + lOOOOx  =  I000(l+10x) 

Figure  F-26  shows  the  scattergram  o£  plotted  points  as  well  as  the 
drawn  sample  regression  line. 
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x  -  Wall  Thickness  (mui. ) 


Figure  F-26 
Regression  Scattergram 

(2)  The  effect  of  wall  thickness  on  bursting  pressure  is 
described  by  the  parameter  B  which  can  be  estimated  from  the  sample 
value  b  =  10000  dynes/cm^/mm.  . 

A  100(1  -a )%  confidence  interval  for  B  is 


b  ±  ta! 2,n-2 


8  . 
y  x 


(I*)' 


where  t  a/£  ?  may  be  evaluated  from  table  H-4  appendix  H. 
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a+bxktt«/2,n-2 


8 


y.x 


1+  ,»(*k  -*_IZ  , 

n  nEx2  -  (Ex)2 


where 


X 


2 


x^  is  the  particular  value  of  x  for  which  P  y.  x  is  to  be 
estimated. 


Thei.  a  90%  confidence  interval  of  My>x  for  x^  s  2.4 
*.05,  1  s  6*  314 

1000  +  10000(2.  4)+ (6.  314)(2449)  /  i  +  -JL2.-.4:2)2  . 

^  3  3(14)-  (6)2 

25000  t  9896 


15104  <  M  <  34896 
y.  x 


We  are  90%  confident  that  the  average  bursting  pressure  will  fall 
within  this  interval  if  the  walls  are  constructed  2.4  mm.  thick. 

The  bursting  pressure  of  any  individual  rocket  motor  whose  wall  is  x 
thick  may  also  be  estimated  by  a  100  (l-o)  confidence  interval. 


a+bxki*  «/2,n-2  Vx 


Tl  +1  +  n(xk  -  *)^ 

V  "  nSx<  -  (E  x)2 


Then  if  the  process  has  been  modified  so  that  wall  thickness  will  be 
2.  4  mm.  ,  a  90%  confidence  interval  for  the  bursting  pressure  of  the 
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next  motor  so  produced  ia 


1000  +  10000(2.4)4  6.314(2449) 

25000  +  18401 

6599  <  y  <  43401 


Thus,  we  are  90Ve  sure  that  any  particular  motor  produced  with  wall 
thickness  of  2.4  mm.  will  have  a  bursting  pressure  within  the  above 
interval. 

f.  The  sample  size  in  the  preceding  example  is  unrealisti¬ 
cally  small,  but  is  used  to  demonstrate  the  regression  computation. 
The  small  sample  size  has  contributed  to  the  large  intervals  obtained. 


1  +  I  +  3(2.  4-Z)‘ 
3  3(14)-(6)‘ 
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APPENDIX  G 

RELIABILITY  EVALUATION,  FAILURE  ANALYSIS 
AND  CORRECTION  --  THE  FEEDBACK  LOOP 


(Not  included  in  this  issue.) 
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APPENDIX  H 
TABLES 

This  appendix  consists  of  assorted  basic  tables  used  in  reliability 
analysis.  These  tables  are  utilized  and  referenced  in  various  state¬ 
ments  and  examples  throughout  the  preceding  appendices. 

Table  H-l  (a  thru  g)  Exponential  Values:  exp  (-x) 

Table  H-2  Normal  Distribution  Probabilities 

Table  H-3  (a  and  b)  x  *"  Distribution  Probabilities 

Table  H-4  t  Distribution  Probabilities 

Table  H-5  (a  thru  d)  F  Distribution  Values 

Table  H-o  Kolmogorov-Smirnov  Critical  Values 

Table  H-7  (a  thru  g)  Confidence  Limits  for  a  Proportion  (one-sided) 

Table  H-8  (a  thru  h)  Confidence  Limits  for  a  Proportion  (two-sided) 

Table  H-9  Ordinates  of  the  Standard  Normal  Curve 

Table  H-10  Gamma  Function  Values 

Table  H-ll(a  thru  c)  Natural  Logarithms 

Figure  H-12  Cumulative  Probability  Curves  for  Poisson 

Distribution 


H-l 


Table  H-la 

Exponential  Values-  e 
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Table  H-l 
Exponential  Values: 
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Table  H-lf 

Exponential.  Values:  exp(-x) 
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Tobla  H-2 

NORMAL  DISTRIBUTION  PROBABILITIES 
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TABLE  H-  3a  --  x*  DISTRIBUTION  PROBABILITY  VALUES 
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Table  H-4 

t  Distribution  Probabilities 


The  first  column  lists  the  number  of  degrees 
of  freedom  (y).  The  headings  of  the  other 
columns  give  probabilities  IP)  for  t  to  ex- 
ceed  numerically  the  entry  value. 
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2.  0423 

2.  3596 

2.  7500 

3.  0298 

40 

0.68066 

1.  1673 

1.6839 

2.  02  1  1 

2.  3289 

2.  7045 

2. 9712 

60 

0. 67862 

1.  1616 

1 . 6707 

2.  0003 

2. 2991 

2.  6603 

2.  91 46 

120 

0. 67656 

1. 1559 

1. 6577 

1.  9799 

2. 2699 

2. 6174 

2.  8599 

« 

0.67449 

1.  1 503 

1 . 6449 

1. 9600 

2. 2414 

2. 5758 

2.  8070 

Adapted  with  special  permission  from  John  Wilev  &  Sons,  Inc.  ,  from 
ELEMENTARY  STATISTICS  by  Paul  G.  Hoel,  (c)l960,  page  243. 
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Cambridge  University  Press,  University  College,  London,  England, 
from  BIOMETRIKA  TABLES  FOR  STATISTICIANS,  edited  by 
E.  S.  Pearson  and  H.  O.  Hartley,  Vol.  1,  Third  Edition, 
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Adapted  with  special  permission  from  Biometrika  Trustees, 
Cambridge  University  Press,  University  College,  London,  England 
from  BIOMETRIKA  TABLES  FOR  STATISTICIANS,  edited  by 
E.  S.  Pearson  and  H.  O.  Hartley,  Vol.  1,  Third  Edition. 
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Table  H-6 

Kolmogorov-Smlrnov  Critical  Valuee  (d^ 


Level  of  significanc 

e  (») 

0.  20 

0,  15 

0.  10 

0.05 

0.  01 

1 

0.  900 

0.925 

0.  950 

0.975 

0.995 

2 

0.  684 

0.  726 

0.  776 

0.842 

0.  929 

3 

0.  565 

0.  597 

0.  642 

0.708 

0.828 

4 

0.494 

0.  525 

0.  564 

0.624 

0,  733 

5 

0.  446 

0.  474 

0.  510 

0.  565 

0.  669 

6 

0.  410 

0.  436 

0.  470 

0.  521 

0.  618 

7 

0.  381 

0.  405 

0.  438 

0.486 

0.  577 

8 

0.  35e 

0.  381 

0.  411 

0.  457 

0.  543 

9 

0.  339 

0.  360 

0.  388 

0.  432 

0  514 

10 

0.  322 

0.  342 

0.  368 

0.410 

0.  490 

11 

0.  307 

0.  326 

0.  352 

0.  391 

0.468 

12 

0.  295 

0.  313 

0.  375 

0.  450 

13 

0.  284 

0.  302 

0.  361 

0.  433 

14 

0.  274 

0.292 

0.  314 

0.  349 

6.  418 

15 

0.  266 

0.283 

0.  304 

0.  338 

0.404 

16 

0.258 

0.274 

0.  295 

0.  328 

0.  392 

17 

0.250 

0.266 

0.286 

0.  318 

0.  381 

10 

0.244 

0.  259 

0.  278 

0.  309 

0.  371 

19 

0.  237 

0.  252 

0.  272 

0.  301 

0.  363 

20 

0.231 

0.  246 

0.264 

0.  294 

0.  356 

23 

0.21 

0.  22 

0.  24 

0.27 

0.  32 

30 

0.  19 

0.  20 

0,  22 

0.  24 

0.  29 

33 

0.  18 

0.  19 

0.21 

0.  23 

0.  27 

over  35 

1.07 

1.  14 

1.22 

1.  36 

1.63 

sPT 

y]7T 

N nr 

JTT 

sTT 

Reprinted  by  special  permission  from  the  Journal  of  American  Statistical 
Association  (The  Kolmogorov-Smirnov  Test  for  Goodness  of  Fit)  by 
Frank  J.  Massey,  Jr.  ,  as  published  in  the  "Journal  of  the  American 
Statistical  Association’’  in  March  1951.  Volume  46,  number  53,  page  70. 
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I  able  H-7c 


CONFIDENCE  LIMITS  FOR  A  PROPORTION  I.ONL -SIDED 

If  the  observed  proportion  is  d/n  enter  the  table  with  n  and  >  for  a  lower 

one-sided  limit. 


d 

90% 

95% 

99% 

d 

90% 

95% 

99%  ) 

d 

90% 

<>9%  i 

i 

n 

=  16 

n 

--  17 

! 
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--  18 
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0 

.866 

.  829 

.  750 
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.  873 

.  8  38 

.763  J 
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880 
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.  847 
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•7’4  ! 

1 
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.651 

1 
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HOI 
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.  700 

.656 

.  570 
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.716 

.  674 

.  590  i 

i  2 

.731 

.  690 

.609  | 
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.  583 

.  497 
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Table  H-7d 

CONFIDENCE  LIMITS  FOR  A  PROPORTION  tONE-SIDED' 

U  the  observed  proportion  is  d/n,  enter  the  table  with  n  and  y  for  a  lower 
one  -sided  limit. 


d  90%  93%  99%  i  d  I  90%  95% 


n  r  19 


!  .  3! I  .  470 
j  .  459  .  418 

.408  .368 

.  358  .  320 

.310  |.2  74 


n  -  20 


0  .891  I 

1  .819  i 


.626  l|  2  .  755-t  J 

.561  |  3  .696 

.502  14  .639 

1.446  5  .  585  + 

!  ! 

j  .  394  !’  6  1.533 
.345  -j*  7  1.482 
1.298  *  8  j  .  433 
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CONFIDENCE  LIMITS  FOR  A  PROPORTION  (ONE-SIDED) 


If  the  observed  proportion  la  d/n,  enter  the  table  with  n  and  y  for  a  lower 
one-sided  limit. 
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0 
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0 
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CONFIDENCE  LIMITS  FOR  A  PROPORTION  (tWO-SIDEO) 
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GAMMA  FUNCTION  VALUES 
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APPENDIX  I 

DEFINITION  OF  ACRONYMS  AND  SYMBOLS 


1-1.  General.  The  more  frequently  used  symbols  and  acrrr.ymc  us 
contained  in  this  handbook  are  defined  below.  Some  are  standard 
definitions  and  others  may  be  uniquely  used  herein.  In  either  case, 
the  definitions  apply  to  usa^e  in  this  handbook. 

1-2.  Ac  ronym  s. 


Ac 

Acceptance  number 

AFDP 

Air  Force  Development  Plan 

AFSCM 

Air  Force  Systems  Command  Manual 

AFSC-TR 

Air  Force  Systems  Command-Technical 
Report 

AGREE 

Advisory  Group  on  Reliability  for  Electronic 
Equipment 

AIAA 

American  Institute  of  Aeronautics  and  Aatro- 
nautic  s 

AIchE 

American  Institute  of  Chemical  Engineers 

AMC 

Army  Materiel  Command 

AMCP 

Army  Materiel  Command  Pamphlet 

AMCR 

Army  Materiel  Command  Regulation 

APE 

Advance  Production  Engineering 

AQL 

Acceptable  Quality  Level 
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AR 

Army  Regulation 

ASMS 

American  Society  of  Mechanical  Engine. 

ASP 

Army  Strategic  Plan 

ASQC 

American  Society  for  Quality  Control 

ASTM 

American  Society  for  Testing  Materials 

BASE 

Basic  Army  Strategic  Estimate 

CDC 

Combat  Developments  Command 

CDP 

Contract  Definition  Phase 

CONUS 

Continental  United  States 

CPFF 

Cost-Plus  -Fixed-F  ee 

-3PM 

Critical  Path  Method 

CRD 

Chief  of  Research  and  Development 

CTP 

Coordinated  Test  Plan 

DA 

Department  of  the  Army 

DCR 

Design  Characteristics  Review 

DoD 

Department  of  Defense 

ECP 

Engineering  Change  Proposal 

ECR 

Engineering  Concept  Review 

ELA 

Electronics  Industries  Assoc  ation 

ET 

Engineering  Test 

ET/ST 

Engineering  Test/Service  Test 

FACS 

Failure  Analysis  and  Control  System 

FARADA 

failure  Rate  Data 
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FMEA 

Failure  Mode  and  Effects  Analysis 

FMSAEG 

Fleet  Missile  Systems  Analysis  and  Evaluation 
Group 

GFE 

Government  Furnished  Equipment 

ICAO 

International  Civil  Aviation  Organization 

ICT 

Inspection  Comparison  Test 

IDEP 

Inter-service  Data  Exchange  Program 

IEEE 

Institute  of  Electrical  and  Electronic  Engineer! 
Inc. 

IFB 

Invitation  for  Bid 

IPR 

In-Process  Review 

IPT 

Initial  Production  Test 

MDT 

Mean  Down  Time 

MIL-SPEC 

Military  Specification 

MIL-STD 

Military  Standard 

MOS 

Military  Occupational  Specialty 

MRBF 

Mean  Rounds  Between  Failure 

MTBF 

Mean  Time  Between  Failures 

MTF 

Mean  Time  to  Failure 

MWO 

Modification  Work  Order 

OASD 

Office  of  the  Assistant  Secretary  of  Defense 

oc 

Operating  Characteristic 

OSD 

Office  of  the  Secretary  of  Defense 
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PCP 

Program  Change  Proposal 

PERT 

Program  Evaluation  and  Review  Technique 

pm2p 

Project  Manager's  Master  Plan 

PSI 

Pounds  per  Square  Inch 

PSR 

Prototype  System  Review 

QMA 

Qualitative  Materiel  Approach 

QMDO 

Qualitative  Materiel  Development  Objective 

QMR 

Qualitative  Materiel  Requirements 

RADC 

Rome  Air  Development  Center 

R&D 

Research  and  Development 

RDTE 

Research,  Development,  Test  and  Evaluation 

Re 

Rejection  number 

RFP 

Request  for  Proposal 

SAE 

Society  of  Automotive  Engineers 

SDR 

Small  Development  Requirements 

SNT 

Society  for  Nondestructive  Testing 

SPR 

Special  Review 

ST 

Service  Test 

STR 

Service  Test  Review 

TAERS 

The  Army  Equipment  Record  System 

TCR 

Technical  Characteristic  Review 

TDP 


Technical  Development  Plan 
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TOE  Table  of  Organization  and  Equipment 

USAMC  United  States  Army  Materiel  Command 

USATECOM  United  States  Army  Test  and  Evaluation 

Command 


WSEIAC 


Weapon  System  Effectiveness  Industry 
Advisory  Committee 


1-3.  Symbols, 
dr 

a 

a 

A 

A 


P 


d 


Shape  parameter  for  the  gamma  distribution 
Level  of  significance 

Estimated  intercept  of  the  linear  regression  line 
Intercept  of  the  linear  regression  line 
Complement  of  the  set  A 

Shape  parameter  of  the  Weibull  distribution 

Estimate  of  the  parameter  P 

Estimated  slope  of  the  linear  regression  line 

Slope  of  the  linear  regression  line 

Chi  squared  random  variable  with  v  degrees  of 
freedom 

/  2  i  \ 

Chi  squared  value  such  that  P  v>  Xa  y}-  a 

Number  of  items  surviving  a  time  terminated 
test 

Maximum  deviation  between  hypothesized  and 
sample  distribution  functions  as  used  for  the 
Kolmogorov-Smirnov  test. 
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dk 

°k 

* 

r\ 

e 

4 

exp(-x) 

Ei 

E(X) 

Efl(r) 

E0(O 

f(s) 

f(S) 

f(x) 

*(*) 

F(x) 

F(xj) 

F(xt) 


Critical  value  for  the  Kolmogorov-Smirnov  test 
Decision  alternative  at  stage  k  (Dynamic  Programming) 

Set  of  all  possible  decision  alternatives  at  stage  k  for 
the  dynamic  programming  formulation 

Scale  parameter  for  the  Weibull  Distribution 

Estimate  of  the  parameter  h 

Base  of  natural  logarithms  (2.  71828.  . . ) 

Element  of 

e-* 

Expected  number  of  observations  falling  in  the  i^1  interval 

Expected  value  of  the  random  variable  X 

Expected  number  of  failurer  required  to  reach  a 
decision  for  a  sequential  test 

Expected  time  duration  of  a  sequential  test 

Probability  density  function  for  a  stress  random 
variable 

Probability  density  function  for  a  strength  random 
variable 

Probability  density  function  for  the  random  variable  X 

Probability  density  function  for  the  standard  normal 
random  variable 

Probability  distribution  function  for  the  random 
variable  X 

Probability  distribution  function  evaluated  at  xi 
Sample  ectimate  of  F(x*) 
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F 

O; 


x »  ^  y 


r  (b) 

y 


c. 


G(xiiyi) 


H 


h(x) 


00 


/ 

k 


k 

k 


K 


F  random  variable  with  and  v  degrees  of  freedom 

X  v  ° 


/ 


F  value  such  that  Pi  F  >  F 

\  *x  '  *y  a>  vx  >  vy 


Gamma  function  evaluated  at  b 

Location  parameter  for  the  Weibull  Distribution 


/  “f(S)dS 

*  s 

Amount  of  effort  required  to  increase  the  reliability 
level  of  subsystem  i  from  x.  to  y. 

Intercept  of  the  acceptance  line  for  a  sequential  test 
Intercept  of  the  rejection  line  for  a  sequential  test 

/  *  f(s)ds 

*  *00 

Null  hypothesis 
Alternative  hypothesis 

Hazard  function  or  instantaneous  failure  rate 
Infinite 

Integration  operator 

Number  of  failures  as  counted  throughout  a  sequential 
life  test 

Number  of  intervals  in  a  frequency  table 

A  typical  stage  number  as  used  in  the  dynamic  pro¬ 
gramming  formulation 

Discrete  random  variable  (e.g.  ,  number  of  failure) 
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X 

X 


X* 


L 

Li 

ln(x) 


y.x 


M 


v 

N 

n 

ni 

n  I 

O. 

1 

<fr 

n 


Scale  parameter  of  the  gamma  distribution 
Constant  failure  rate 
Required  system  failure  rate 
Failure  rate  allocated  to  subsystem  i 
Lower  specification  limit  (MIL-STD-^14) 

Lower  limit  of  the  i&-  interval 

Natural  logaritnm  of  x 
Population  mean 

Expected  response  associated  with  x  as  included 
in  a  linear  regression  model 

Allowable  percent  defective  (MIL-STD-414) 

Number  of  degrees  of  freedom 

Total  number  of  modules  in  the  sys'  :m 

Sample  size 

tH 

Number  of  modules  in  the  i  “  subsystem 
n  (n-1)  (n-2)  ...  (1)  =  P (n  +  1) 

tH 

Number  of  sample  observation?  falling  in  the  i  Ui  interval 
Empty  set 

Multiplication  operator 
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i#i*i 


X1X2X3-  •  **11 

Probability  of  failure  on  a  single  trial  (a  para¬ 
meter  of  the  binomial  distribution) 

Probability  that  a  single  item  will  successfully 
fulfill  a  given  mission 

Estimate  of  the  parameter  p 

Probability  that  the  i—  element  succeeds 


Estimated  lot  percent  defective  with  respect  to  the 
lower  specification  limit  (MIL-STD-414) 

Probability  that  the  switch  will  operate  when  it 
should  operate 


Probability  that  the  switch  will  not  operate  prematurely 


Probability  of  acceptance 


P(B  /  A) 


Probability  that  the  event  A  will  occur 

Probability  that  the  event  B  will  occur  if  it  is  known 
that  event  A  will  occur 


Probability  that  tne  i  element  will  fail 

Probability  that  the  switch  will  fail  to  operate  when 
it  should  operate 

Probability  that  the  switch  will  operate  prematurely 

System  unreliability 
Unreliability  of  the  i^1  subsystem 
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QL 


r 


R 

R* 


i 


% 

*i 

R(x) 

ft(x) 

R8(x) 

Ra 

R(T) 

R(T) 

^t<8k,dk) 

P/PQ 

l 


Quality  index  pertaining  to  the  lower  specifica¬ 
tion  limit  (MIL-STD-414) 

Number  of  failures  occurring  during  a  life  test 
Rejection  number 

Reliability 

System  reliability  requirement 

The  reliability  requirement  apportioned  to 
subsystem  i 

Reliability  level  of  subsystem  i 
Unreliability  of  subsystem  i 

Reliability  function  for  the  random  variable  X 
Estimated  reliability  function 
System  reliability  function 

^System  reliability 

Reliability  for  a  mission  of  T  units  duration 
Estimate  of  R(T) 

Return  function  pertaining  to  stage  k  in  the  dynamic 
programming  formulation 

Unit  of  air  density 
Summation  operator 
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n 


(T 


s 

s 

B 

2 

8 


Bk 


e 

A 

6 


e. 

i 

e 

o 


t 


t 


) 


X|+  Xj+  ...  +  Xa 

Variance 

Standard  deviation 

Stress  random  variable 

Slope  of  the  sequential  test  decision  lines 

Estimate  of  the  parameter  gr 

Estimate  of  the  parameter  <r^ 

State  at  stage  k  (Dynamic  Programming) 

Standard  error  of  estimate  for  the  regression  model 

Strength  random  variable 

Set  of  all  possible  states  at  stage  k  in  the  dynamic 
programming  formulation 

Mean  time  between  failures 
Estimate  of  the  parameter  9 

Minimum  acceptable  mean  life  of  the  i^  subsystem 
Acceptable  mean  life 
Unacceptable  mean  life 
System  mission  time 

Length  of  time  a  sequential  life  test  has  been 
operative 

Mission  time  of  the  i^  subsystem 
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Z 

z  a 

100  (1 -a)% 

lim 

h  — 

< 

> 

CL 

u 

n 


Standard  normal  random  variable 
z  value  ouch  that  P  (Z  >  za)  ~  a 

Confidence  level  expressed  as  a  percentage 
Limit  as  h  approaches  zero 

Combination  of  n  things  taken  k  at  a  time  (  n* 

\  k  t (n-k)  ! 

Less  than 

Less  than  or  equal  to 

Greater  than 

Greater  than  or  equal  to 

Subset 

Union 

Intersection 
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INDEX 


Accelerated  life  testing,  6-5 
Acceptable  mean  life,  F-33,  F-44 
Acceptable  quality  level,  B-25,  B-26, 
F-58  to  F-62 

Acceptance  number,  F-61 
Acceptance  region,  F-31,  F-32, 

F -34,  F-37,  F -39,  F-40 
Acceptance  test,  1-3,  2-2,  2-17, 

6-2,  6-4,  F -50  to  F-62 
Achieved  reliability,  2-9,  5-1 
Active  redundancy, 

(see  Parallel) 

Advanced  production  engineering, 

B-23,  B-24 
AGREE 

apportionment  technique,  4-10, 

4-1  1,  D-22  to  D-24 
prediction  technique,  4-6,  4-7 
Allocation, 

(see  Apportionment) 

Apportionment 

general,  1-4,  2-5,  4-9,  B-i4  to 
B- 16,  B-20,  B-2 1,  B-23,  C-17, 

C- 18,  D-l,  D-2 1  to  D-43,  E-16 
purpose,  4-10,  5-6,  5-7 
some  specific  techniques,  4-10, 
4-11,  D-2 1  to  D-42,  E-16  to  E-21 
ARINC 

apportionment  technique,  4-11, 
D-24  to  D-26 

prediction  technique,  4-8,  4-9 
Attributes  inspection,  1-13,  F-61 
Availability,  1-10,  1-11,  3-3,  7-6, 
A-66,  A-68,  A-70,  C-2,  C-9,  C-28 


Bayes  theorem,  D-13  to  D-16 
Bernoulli  trials,  A-24 
Binomial  distribution 

approach  to  nonparametric 
testing,  F-2 
general,  D-4 

probability  density  function,  A-24, 
A-25,  F-41,  F-44 
random  variable,  A-24 
reliability  function,  A-26,  A-27, 

F -39 

Block  diagram,  4-2,  4-3,  B-15, 
B-20,  B-2 1,  D-l  toD-5,  D-9, 

D-l  1,  D-14,  D-15,  D-  17  to 
D-20,  E-5,  E-8,  E-9 


Capability,  1-10,  1-11,  7-6,  A-66, 
A-69,  A-7 1 
Category  I  teBts 

check  tests,  1-3,  6-8,  B-25 
confirmatory  tests  (type  I),  1-3, 
6-7.  6-8,  B -27 
ei.£/neering  tests,  1-3,  5-10, 

6-8,  B-22,  3-24,  B-25 
environmental  tests,  6-8 
service  tests,  1-3,  5-10,  6-8, 
B-22,  B-24,  B-25 
Category  II  tests 

comparison  tests,  6-10 
component  development  tests,  6-9 
engineer  design  tests,  5-10,  6-9 
engineering  change  tests,  6-9, 
B-26 
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Category  II  tests  (Cont'd) 
feasibility  tests,  6-9 
initial  production  tests,  1-3,  3-15, 
6-10,  B-27 

preproduction  tests,  1-3,  3-15, 
6-10,  B-27 
research  tests,  6-9 
R&D  acceptance  tests,  1-3,  6-9 
Central  tendency,  A-13  to  A-15,  A-17 
A-22 

Check  test,  1-3,  6-8 
Chi  Square  goodness-of-fit  test,  F-13 
to  F-16 

Combat  ready  rate,  3-3,  C-2,  C-9 
(see  also  Availability) 

Complement  of  a  set,  A-5 
Complementary  events,  A-12,  A-13, 
D-3 

Conceptual  phase,  1-5,  3-1,  4-9, 

6-7,  6-9,  B-9,  B-ll,  B-12,  B-30 
Conditional  probability,  A-8,  A-23, 
D-15 

Confidence  interval,  6-3,  C-39,  E-I4, 
F-l  to  F-4,  F-19,  F-2 1  to  F-24, 

F -27  to  F-30,  F -64,  F-66  to  F-69 
Confidence  level,  2-10,  C-3,  C-31, 
C-33,  F-2,  F-2 1  to  F-23,  F-38 
(see  also  Significance  level  and 
risk) 

Configuration  management,  3-7,  3-8, 
B-18 

Confirmatory  test,  1-3,  3-15,  6-7, 
6-8,  6-10,  B-27 
Contract 

cost-plus -fixed-fee,  C-23,  C-26 
development,  2-13,  B-19,  C-23, 
C-24 

fixed  price,  C-31,  C-32 
incentive,  C-26  to  C-29 


Contract  (Cont'd) 

multiple  incentives,  C-31  to 
C-39 

production,  B-26,  C-24  to 
C-26 

reliability  clauses  for,  C-23  to 
C-39 

Contract  definition  phase,  3-8, 

B  - 17 

Contractor  capability,  B-25 
Contractor  proposal,  B-15  to  B-19 
Contractor  reliability  program, 

2-3  to  2-10,  2-13,  3-10 
Coordinated  test  program,  5-10, 

6- 19,  B-18 

Corrective  action,  2-9,  7-11, 

7- 13  to  7-15,  B-l,  B-20,  B-21, 
B-23,  B-25,  B-27,  C-22,  C-26 

Cost-effectiveness,  3-7,  7-2,  7-3, 
B-12 

Critical  items,  2-5 
D 

Data 

analysis  of,  7-1,  7-11  to  7-14, 
C-21 

collection  of,  7-1,  7-3  to  7-8, 
7-10,  C-21,  C-33 
documentation  of,  7-3  to  7-10 
elements,  7-3,  7-7,  7-8 
failure,  7-1  to  7-15,  C-21 
quality,  7-10,  7-11 
sources  of,  7-4  tc  7-6,  7-10, 
7-11 

use  of,  7-1,  7-11  to  7-14,  C-21 
Decreasing  failure  rate,  A-46 
Definition  phase,  1-5,  3-1,  3-8, 
6-7,  6-9,  B-9,  B-12  to  B-20. 
B-30 


•  »  • 
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Degrees  of  freedom,  F-23 
Demonstration  and  teat,  2-9,  2-10, 

2- 17,  6-1  to  6-22,  B-14,  B-22, 

B-24,  B-26,  C-19  to  C-20,  C-23, 
C-25,  C-26,  C-3 1,  F-l  to  F-69 

Dependability,  1-10,  1-11,  A-66, 

A-69  to  A-7 1 

Dependent  events,  A-8  to  A- 10 
Deployment,  planned,  05 
Derating,  5-3,  B-20 
Descriptive  statistics,  A- 13  to  A-20 
Descriptors,  1-12,  1-13,  A-72,  A-73 
Design 

detailed,  1-3,  B-22,  B-23,  C-21 
engineering,  1-2,  1-3,  C-21 
formulation,  1-4,  5-1 
for  reliability,  2-2,  5-1  to  5-10, 

B- 16,  E-l  to  E-21 
preliminary,  C-17 
principles,  5-2  to  5-" 
requirements,  1-5 
reviev,  1-4,  2-6,  3-6,  5-2,  5-7 
to  5-  .0,  B-22,  C-20,  C-21 
simplification,  B-23,  C-28 
specification,  4-1 
stress-strength,  5-2  to  5-4 
Design  characteristics  review,  5- JO, 

B- 18,  B-22,  C-20 

Determination  of  underlying  distribution, 
F-4  to  F- 18 

Development  description,  3-8,  3-9 
Development  phase,  1-3,  1-5,  6-7, 

7-10,  B-9,  B-19  to  £-25,  B-31, 

E-l 

Development  tests,  2-4,  6-9 
Disposal  phase,  1-6,  B-9,  B-28,  B-Z9, 
B-32 

Documentation  of  requirements,  1-4, 

3- 1  to  3-15,  B- 13,  B-14,  C-l  to 
C-39 

Durability,  C-4 


) 


Dynamic  programming,  D-30  to 
D-43,  E- 19  to  E-21 


Effectiveness  f 

cost,  3-7,  7-2,  7-3  I 

determination  of,  A-71,  A-72  j 

general,  1-1  t 

range  of,  C-32  to  C-39  { 

system,  1-1,  1-10,  1-11,  7-6,  j 

A-66  to  A-72  {_■ 

Effort  function,  4-11,  D-27,  D-32,  j 

D-33,  D  35,  D-37,  E-17,  E-19,  ) 

E-20 

Element  of  a  set,  A-2,  A-3 
Engineering  change  proposal,  7-13, 

C-27 

Engineering  concept  review,  5-10 

B-18,  B-20,  C-20  s 

Engineering  design,  1-2,  1-3,  | 

B-20,  B-22,  B-23,  C-21  j 

Environmental  control,  5-4  - 

Environmental  factors,  7-5  j 

Equal  apportionment  technique,  4-10,  f 
D-21,  D-22  ] 

Equally  likely  eventB,  A-l,  A-7  \ 

Estimated  lot  percent  defective, 

F -59,  F -60  j 

Evaluation  of  proposal,  1-4,  2-13,  5 

2-15  to  2-17  i 

Expected  number  of  failures,  F-47  * 

to  F -52  | 

Expected  te 8 1  duration,  F-45,  F-48  j 

to  F-54  { 

Expected  value  3, 

definition,  A-22  ‘ 

exponential,  A-42  1 

gamma,  A-51 

lognormal.  A- 34  j 

normal,  A-29  : 
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Expected  value  (Cont'd) 
poisson,  A-39 
Weibull,  A-47 
Exponential  distribution 

determination  of,  F-4  to  F-7, 

F- 13  to  F- 18 

estimation  of  parameters,  F-4, 

F-  18  to  F -24 
expected  value,  A-42 
hazard  function,  A -44  to  A-46 
probability  density  function,  A-42, 
C-2,  F- 19 

probability  distribution  function, 
A-43 

random  variable,  A-42 
reliability  function,  A-43  to  A-46, 
C-l,  F  -  19  to  F-2  1,  F -23,  F-24 
variance,  A-43 
Exponential  failure  times 
acceptance  tests,  F-57 
parallel  model,  D-19,  D-20 
partial  redundancy  model,  D-18, 
D-19 

series  model,  D-19,  D-20 
standby  redundancy  model,  D-6 
to  D-8,  D- 16,  D-17 
tests  of  hypothesis,  F-32  to  F-56 

F 

Failure  analysis,  1-4,  2-9,  7-11  to 
7-14,  C-21  to  C-23 
Failure  analysis  and  control  system, 
7-2,  7-3 

Failure,  definition  of,  B-20,  C-l  to 
C-3,  C-9,  C-22,  C-3 1,  C-33 
Failure  modes,  5-5,  7-2,  B-20,  B-22, 
B-23,  D-9,  D- 12,  D-43,  E-4 
Failure  mode  and  effect  analysis, 

5-5,  B-21 


Failure  rate,  1-13,  3-13,  4-5  to 
4-8,  A-38  to  A-40,  A-42, 

A-44,  A-46,  A-73,  B-22,  C-5, 
C-19,  C-37,  D-7,  D-16  to  D-19, 
D-24,  D-25,  E-6  to  E-8,  F-19 
(see  also  Hazard  function) 

Failure  reporting,  2-9,  7-1  to 
7-15,  C-21  to  C-23 
Failure  sensing  devices,  D-6 
Failure  terminated  tests,  6-2, 

F-19  to  F-24,  F-32  to  F-38, 

F-57 

FAR AJDA  program,  7-4,  7-5,  E-13 
Feasibility  study,  B-12,  B-13,  B-15 
Feedback,  1-4,  2-9,  2-21,  7-8  to 
7-11,  B-15,  B-28,  C- 17 
Forecasting  technological,  B-ll 
Formulation  of  design,  1-4,  5-1 
Frequency  table.  A- 14,  A- 15 

G 

Gamma  distribution 

expected  value,  A-51 
hazard  function,  A-53  to  A-55 
probability  density  function,  A-51 
probability  distribution  function, 
A-52 

random  variable,  A--51 
reliability  function,  A-52  to  A-55 
variance,  A-51 
Goodness -of-fit  test 

analytical,  F-13toF-18 
graphical,  F-4  to  F-12 
Government  furnished  equipment, 
B-21,  B-22 

Guidance  documents,  B-ll 
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H 

Hazard  function 

as  a  reliability  descriptor,  A-73 
definition,  A-21,  A-23 
exponential,  A-44  to  A-46 
gamma,  A-53  to  A-55 
lognormal,  A-36,  A-37 
normal,  A-30  to  A-33 
Weibull,  A-49,  A-50,  F-57 
Histogram,  A- 15,  A- 16 
Human  engineering,  5-7 
Hypotheses,  F-30  to  F-32,  F-56 
Hypothesis  tests,  6-2,  6-4,  F-30  to 
F-56 

I 

1DEF,  7-5,  7-6 

Importance  factor,  D-22,  D-23 
Increasing  failure  rate,  A-26,  A-46 
Independent  events,  A-9  to  A-ll, 

A- 13,  D-l,  D-7,  D-19,  D-33, 

D-3* 

Inher  availability,  C-9 
Inherent  reliability,  1-5,  5-1,  7-10, 
7-11,  C-2 

In-house  statistical  analysis,  B-27, 

B-28 

Initial  production  test,  1-3,  3-15, 

6-7,  6-10, 

In-process  review,  5-9,  B-18,  B-20, 
B-22  to  B-25,  C-20 
Inspection  comparison  tests,  B-28 
Instantaneous  failure  rate 
(see  Hazard  function) 

Integrated  tests,  1-3,  6-14  to6-16,B-24 
Intersection  of  events,  D-3 
Intersection  of  sets,  A-4,  A-10,  A-ll 
Invitation  for  bids,  B-24,  B-25 


K 

Kolmogorov-Smirnov  test,  F-16 
to  F- 18 

L 

Life  cycle 

applicable  documents,  1-8  to  1-9 
conceptual  phase,  1-5,  3-1,  4-9, 
6-7,  6-9,  B-9,  B-ll.  B-12, 

B  -30 

considerations  in,  1-7 
definition  phase,  1-5,  3-1,  3-8, 
6-7,  6-9,  B-9,  B-12  to  B-19, 

B  -30 

development  phase,  1-3,  1-5, 

6- 7,  7-10,  B-9,  B-19  to  B-25, 
B-31,  E-l 

disposal  phase,  1-6,  B-9,  B-28, 
B-29,  B-32 

feedback,  1-4,  2-9,  2-21,  7-8  to 

7- 11,  C-  17 

general,  1-5,  1-6,  2-1 
operational  phase,  1-3,  1-6,  2-1, 
6-7,  7-10,  7-11,  B-9,  B-28, 
B-29,  B-32 

production  phase,  1-3,  1-6,  2-8, 
2-9,  6-7,  7-10,  7-11,  B-9, 

B-25  to  B-28,  B-32 
system,  1-4,  1-17,  B-l 
teat  programming,  6-12  io  6-16 
Life  testing 

(see  demonstration  and  test) 

(see  test  and  demonstration) 

(see  testing) 

Linear  regression,  F-63  to  F-69 
Linear  regression  equation,  F-63, 
F-65 
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Lognormal  distribution 
expected  value,  A -34 
hazard  function,  A-30  to  A-33 
probability  density  function,  A-34 
probability  distribution  function, 
A-34 

random  variable,  A-34 
reliability  function,  A-34  to  A -36 
variance,  A-34 

Lower  specification  limit,  F-58 
M 

Maintainability,  7-6 
Maintenance,  5-6,  C-l,  C-5,  C-6, 
C-10,  C-  13  to  C-15,  C- 19 
Maintenance  personnel,  C-15,  C-16 
Maintenance  support  plan,  B-22 
Matching  moments,  F-24  to  F-26 
Materiel  life  cycle 
(see  Life  cycle) 

Maximum  allowable  percent  defec¬ 
tive,  F-58  to  F -60 
Maximum  likelihood,  F-24,  F-27 
Mean  downtime,  3-3,  C-lltoC-13, 
C-28 

Mean  time  between  failures,  1-13, 

3- 13,  4-11,  A-72,  C-l  to  C-3, 
C-5,  C-16,  C-20,  C-28,  C-37 
to  C-39,  D-22,  F-19  to  F-24, 
F-32  to  F-57 

Mean  time  to  failure 

(see  Mean  time  between  failures) 
Minimization  of  effort  algorithm, 

4- 11,  D-26  to  D-30,  E-16toE-21 
Mission  duration,  3-3,  C-10,  C-ll, 

C-37 

Mission  profile,  3-11,  C-8,  C-9, 

E-3 

Mission  reliability,  3-3,  C-l,  C-2, 
C-7  to  C-9 


Model,  reliability 

general,  2-5,  4-1  to  4-3, 

6-19,  B-15,  B-20,  B-2 1, 

B-23,  D-l 

parallel,  D-3,  D-4,  D-16, 

D  -  19,  D-20 

partial  redundancy,  D-4  to  D-6, 
D-18,  D-19 

series,  D-l  to  D-3,  D-16, 

D-19,  D-20,  D-24,  D-26, 
D-27,  D-32,  D-33 
standby  redundancy,  D-6  to 
D- 13,  D-16,  D- 17 
use  of  Bayes  theorem,  D-13  to 
D-16 

Model,  system  effectiveness, 

A-68  to  A-7 1 

Modification  work  order,  7-13 

Module,  D-22,  D-23 

Monitoring  a  reliability  program, 

1- 4,  2-1,  2-3,  2-4,  2-8,  2-9, 

2- 15,  5-8 

Monotone  failure  rate,  A -46 

Mutually  exclusive  events,  A-l, 

A- 12,  D-13 

N 

Nonparametric  analysis,  F-2  to 
F-4 

Nonparametric  sampling  plans, 

F -60  to  F-62 

Nonreplacement  tests,  6-2,  F-2 
to  F-4,  F-19  to  F-24,  F-32 
to  F -56,  F-61 

Nontime  dependent  items,  C-3, 
F-3,  F-61 

Normal  distribution 

determination  of,  F-9  to  F-18 
estimation  of  parameters, 

F- 17,  F-18,  F-27  to  F-30 
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Normal  distribution  (Cont'd) 
expected  value,  A-29 
hazard  function,  A-30  to  A-33 
probability  density  function, 

A- 18,  A-19,  A -28,  A-29,  A-55 
to  A-57,  F-27 

probability  distribution  function, 
A-30 

random  variable,  A-28  to  A-30 
reliability  function,  A-30  to  A-33, 

F -28 

variance,  A-28,  A-29 
Normal  failure  times 

acceptance  tests,  F-58  to  F-60 
tests  of  hypothesis,  F-56 
Normal  probability  paper,  F-9  to  F-12 

O 

One  shot  item,  1-12,  6-5,  6-6,  A-55, 
A-73,  C-3,  C-5,  F-3,  F-61 
Operating  characteristics  curve,  F-31, 
F-33  to  F-35,  F-39  to  F-42,  F-45 
to  F-47,  F-49  to  F-5 1,  F-57,  F-60, 
F -62 

Operational  environment,  3-3,  C-10 
Operational  readiness,  C-12 
Operational  phase,  1-3,  1-6,  2-1, 

6-7,  7-10,  7-11,  B-9,  B-28, 

B -29,  B-32 

Organization,  2-3,  2-17,  B-15 
P 

Parallel  (redundant)  functional  con¬ 
figuration,  4-1,  C-28,  D-3,  D-4, 
D-19,  D-20,  D-4? 

Parameters 

definition,  6-2 

estimation  of,  6-2  to  6-4,  F - 1  to 
F -30,  F-63  to  F-69 


Parameters  (Cont'd) 
general,  C-2 

test  of  hypothesis,  6-4,  F-30 
to  F-56 

Partially  redundant  functional 
configuration,  4-2,  D-4  to 
D-6,  D- 18 

Parts  reliability, B -29 

Parts  reliability  improvement,  2-5 

Point  estimation,  6-3,  F-l  to  F-4, 

F- 19  to  F-30,  F-63  to  F-67 
Poisson  distribution 
expected  value,  A-39 
probability  density  function,  A-38 
random  variable,  A-38 
reliability  function,  A-40  to  A-42, 
F-39 

variance,  A-39 
Pcisson  process,  A-38 
Prediction 

design  procedure,  4-5,  4-6, 

E-2  to  E - 16 

feasibility  procedure,  4-4,  4-5 
general,  1-4,  2-5,  4-3,  4-4, 

B-  14  to  B-  17,  B-20,  B-21, 

B-23,  C- 19,  D-l,  D- 16  to  D-21 
purpose  and  uses,  4-3,  4-4,  5-2, 
5-6,  5-7,  E-l 

some  specific  techniques,  4-6 
to  4-8 

Preliminary  design,  1-3,  B-19, 
B-20.  C- 17,  C-21 
Preproduction  conference,  B-26 
Probability 

complementary  events,  D-3 
conditional,  A-8,  A-23,  D-15 
definition,  A-l 
function,  A -6 

independent  events,  D-l,  D-33, 
D-35 
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Probability  (Cont'd) 

intersection  of  events,  A-10,  A-ll, 
D-2,  D-3 
joint,  A-9,  A-10 
measurement  scale,  A-l 
union  of  events,  A-ll,  A-12 
Probability  density  function 
binomial,  A -24,  A -25 
definition,  A-21,  A-22 
exponential,  A-42,  C-2,  F-I9 
gamma,  A- 5 1 
general,  D-7 
histogram,  A-15,  A-16 
lognormal,  A-34 

normal,  A-18,  A-19,  A-28,  A-29, 
A-55  to  A- 57,  F -27 
poisson,  A-38 

stress -strength,  A-55  to  A-65 
Weibull,  A-46,  F-24 
Probability  distribution  function 
definition,  A-19,  A-22,  A-23 
exponential,  A -43 
gamma,  A- 52 
lognormal,  A-34 
normal,  A-30 
Weibull,  A-48 

Probability  of  acceptance,  F-31, 

F-33  to  F -36,  F-39,  F-42,  F-43, 

F -60,  F-61 

Probability  of  rejection 

(see  Probability  of  acceptance) 
Production  description,  3-8,  3-15 
Production  phase 

feedback  data,  7-10,  7-11 
general,  1-3,  1-6,  6-7,  B-9, 

B-24,  B-25  to  B-28,  B-32 
manufacturing  controls,  2-8,  2-9 
Project  engineering,  1-2 
Project  management,  1-2 


Proposal,  B-15  to  B-19 
Prototype  systems  review,  5-10, 
B-23,  C-20 

Prototype  testing,  1-3,  B-24 
Q 

Qualitative  materiel  approach, 

B- 12 

Qualitative  materiel  development 
objective,  3-8,  B-ll,  B-12 
Qualitative  materiel  requirements, 
1-7,  2-2,  3-1  to  3-5,  4-3,  5-9, 
5-10,  6-8,  6-12,  6-17,  B-ll  to 
B - 1 3,  B-18,  B-23,  B-24,  B-26, 
B-28,  C-l  to  C-5 

Quality  assurance,  3-7,  3-9,  3-15, 
7-10,  7-11,  B-24,  C-21,  C-25 
Quality  index,  F-58,  F-60 
Quantitative  reliability  requirements, 
3-13,  3-14,  C-4 

R 

Random  variable 
binomial,  A-24 
definition,  A-19,  A-21,  F-l 
exponential,  A-42 
gamma,  A  -  5 1 
lognormal,  A-34 
normal,  A-28 
poisson,  A-38 

standard  normal,  A-28  to  A-30 
stress-strength,  A-55 
Weibull,  A-46 

Reaction  time,  3-3,  C-6,  C-7 
Record  keeping  system,  B-14 
Recursion  equations,  D-31,  D-34, 
D-35,  D-37 
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R&D  acceptance  test,  1-3,  6-7,  6-9, 
B-24 

Redundancy,  5-4,  B-20,  C-28,  D-3 
to  D- 13 

Redundant  functional  configuration 
(see  Parallel  functional  con¬ 
figuration) 

Regression  analysis,  6-4,  F-62, 

F -69 

Reliability 

achieved,  2-9,  5-1 
after  storage,  3-3,  C-2,  C-13 
apportionment,  1-4,  2-5,  4-9  to 
4-11,  5-6,  5-7,  B-14  to  B-16, 
B-20,  B-21,  B-23,  C-17,  C-18, 
D-2 1  to  D-42,  E-  16  to  E-21 
as  a  function  of  stress -strength, 

A -58 

as  a  growth  process,  1-2  to  1-4, 
B-21 

contractor  program,  2-3  to  2-10, 
2-13,  3-10 

data,  7-1  to  7-15,  C-33 
definition  of,  1-1,  1-12,  C-2,  C-3, 
E-6 

descriptors,  1-12,  1-13,  A-72, 
A-73 

design  for,  2-2,  5-1  to  5-10,  B-16, 
E-l  to  E-21 
desired,  C-8,  C-33 
documentation  of,  B-13,  B-14 
documents  applicable  to,  1-8,  1-9, 
1-13  to  1-16 
engineering,  1-1 

estimation,  6-2  to  6-4,  F-2  to  F-4, 
F- 19  to  F -22,  F-27  to  F-30 
feasibility,  1-1,  1-4,  4-4,  5-10, 

B- 12,  B-13,  B - 1 5,  C-3  to  C-5 


Reliability  (Cont'd) 

function,  1-4,  A-21,  A-23,  A-2 6, 
A-27,  A-30  to  A-36,  A-40  to 
A-46,  A -48  toA-50,  A-52  to 
A -55,  A  -  58,  C-l,  F -20,  F-23, 

F -24,  F -28,  F-39 
goal,  B-20,  B-21,  C-17  to  C-19, 
C-2 1,  C-27,  D-21,  D-29,  D-32 
to  D-36,  D-42 
improvement,  3-13 
incentive  contracting,  C-26  to 
C-39 

inherent,  1-5,  5-1,  7-10,  7-11, 
C-2 

levels,  1-2,  C-8,  C-23,  C-28, 

C - 30,  C-31,  C-33 
milestones,  B-8  to  B-32 
mission,  3-3,  C-l,  C-2,  C-l  to 
C-9 

model,  2-5,  4-1  to  4-3,  6-19, 
B-15,  B-20,  B-21,  B-23,  D-l 
to  D-43,  E-5 

multiple  incentive  contracting, 
C-31  to  C-33 

network  diagram,  B-8  to  B-32 
of  rebuilt  equipment,  B-29 
organization,  2-3,  2-17,  B-15 
prediction,  1-4,  2-5,  4-3  to  4-8, 
5-2,  5-6,  5-7,  B-14  to  B- 17, 
B-20,  B-21,  B-23,  C-19,  D-l, 
D-  16  to  D-21,  E-l  to  E- 16 
program  managing,  1-4,  2-11 
to  2-17,  B -  1  to  B-32 
program  monitoring,  1-4,  2-2 
to  2-4,  2-11  to  2-17,  B-l  to 
B-32 

program  planning,  1-4,  B-l  to 
B-32,  C- 16  to  C-23 
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Reliability  (Cont'd) 

program  review,  2-4 
records,  B-27 

relationship  to  system  effective¬ 
ness,  1-1,  1-10 
required,  C-8,  C-28 
requirements,  2-11,  2-15,  3-1 
to  3-15,  B-ll,  B - 17,  C-l  to 
C-39,  0-2 1,  D-22,  D-26,  D-27, 
D-30,  D-39,  E-6  to  E-8 
storage,  B-28,  B-29 
subcontractor  program,  2-7 
test  and  demonstration,  2-9,  2-10, 
2-17,  6-1  to  6-22,  B- 14,  B-22, 

B -24,  B -26,  C-19.  F-l  to  F-69 
trade-offs,  2-8,  2-15,  4-4,  B-12, 

B -  1 5,  B-  17,  B-20  to  B-23,  B-27 
training,  1-4,  2-7,  2-17  to  2-21, 

B-  15,  B-  19 

Reliability  margin,  5-3,  C-16,  C-17, 
C-28 

Replacement  tests,  6-2,  F-19  to  F-23, 
F-32  to  F- 56 

Request  for  proposal,  1-4,  1-7,  2-11 
to  2-13,  4-1,  B-  14,  B- 1 5,  B-25 

Required  review  points 

design  characteristics  review, 

5-10 

engineering  concept  review,  5-10 
prototype  systems  review,  5-10 
service  test  review,  5-10 
special  review,  5-10 
technical  characteristics  review, 
5-9,  5-10 

Requirements,  reliability,  2-11,  2-15, 
3-1  to  3-15,  B-ll,  C-l  to  C-39, 
0-21,  D-22,  D-26,  D-27,  D-29, 
D-30,  D-39,  E-6  to  E-8 

Research  &  technology  resume,  1-4, 
3-4 


Rejection  number,  F-39,  F-40, 

F -42,  F -43,  F-61 
Risks,  6-13,  6-14,  C-33,  C-37, 

F-3 1,  F -33,  F-40,  F-44, 

F-57 

(see  also  Significance  level) 

(see  also  Confidence  level) 

S 

Sample 

mean,  F-58,  F-60 
standard  deviation,  F-58,  F-60 
Sample  size,  C-19,  F-2,  F-4, 

F-7,  F-9,  F- 16,  F-19,  F-22, 

F -24,  F -27,  F -33,  F-43,  F-45, 
F-58,  F -63,  F -64,  F-69 
Sampling 

error,  C-39,  F-31 
plans,  F-57,  F-58,  F-61,  F-62 
random,  F-31 
Self  healing  devices,  5-5 
Semi-log  graph  paper,  F-4,  F-5 
Sequential  decision  criteria,  F-45, 
F-46,  F -49,  F-50,  F-55 
Sequential  tests,  C-31,  F-44  to 
F-57 

Series  functional  configuration,  4-1, 
D-l  to  D-3,  D-19  to  D-22,  D-24, 
D-26,  D-32,  D-33 
Service  test  reviev/,  5-10,  C-20 
Sets 

complement,  A-5,  A- 12 
definition,  A-2 
element  of,  A-2,  A-3 
empty,  A-2,  A-3 
finite.  A-2,  A-3 
infinite,  A-2 

intersections,  A-4,  A-10,  A-ll 
space,  A-2  to  A-5 
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Seta  (Cont’d) 

subset,  A-2,  A-3 
union,  A-3,  A-ll,  A-12 
Shape  of  data  distribution,  A- 13, 

A- 18 

Significance  level,  F-13,  F-16, 

F-3 1,  F-32,  F -37,  F-38,  F-40 
(see  also  Confidence  level) 

(see  also  Risks) 

Small  development  requirements, 

1-7,  3-1  to  3-5,  4-3,  5-9,  5-10, 
6-8,  6-12,  6-17,  B-12,  C-l  to 
C-5 

Space,  A-2  to  A-5 
Special  review,  5-10,  C-21 
Special  tests 

aircraft  &  allied  equipment  tests, 
6-11 

confirmatory  type  II  testa,  1-3, 

6-7,  6-10,  B-2? 
military  potential  teste,  6-10 
nuclear  weapons  tests,  6-11 
surveillance,  6-10 
troop  tests,  6-11 
Specifications,  3-6  to  3-15,  C-20 
Standard  deviation,  A-17,  A-28,  F-58 
Standard  normal  distribution,  A-28 
to  A-30 

Standardization,  5-2,  B-16,  B-20 
Standby  redundancy  functional  con¬ 
figuration 

exponential  model,  D-6,  D-7 
general,  4-2,  D-6  to  D-13,  D-16, 
D- 17 

general  model,  D-7  to  D-9 
imperfect  switching  model,  D-9 
to  D-13 

Statistical  inference 

estimation,  F-I  to  F-30,  F-63  tc 
F-69 

test  of  hypothesis,  F-30  to  F-56 


Statistics 

definition,  A- 13 
descriptive,  A-13  to  A-20 
Stress-strength 
analysis,  7-5 

design  approach,  5-2  to  5-4 
normal  probability  density 
function,  A -55 

probability  density  functions, 
A-55  to  A-65 
random  variable,  A-55 
reliability  function.  A-  58 
testing,  6-5,  6-6 

Subcontractor  reliability  program, 
2-7 

Switching  devices,  D-6,  D-7,  D-9 
to  D-13 

System  description,  3-8 
System  effectiveness 

availability,  1-10,  1-11,  7-6, 
A-66,  A-68,  A -70 
capability,  1-10,  1-11,  A-66, 
A-69,  A-71 

dependability,  1-10,  1-11,  A-66, 
A-69  to  A-71 
example,  A-66  to  A-72 
general,  1-1,  7-6,  B-12 
model,  A-68  to  A-71 
relationship  to  reliability,  1-1, 
1-10 

(see  also  Effectiveness) 

System  functional  configuration 

parallel  (redundant),  4-1,  C-28, 
D-3,  D-4,  D- 19,  D-20,  D-43 
partially  redundant,  4-2,  D-4 
to  D-6,  D- 18 

series,  4-1,  D-l  to  D-3,  D-19 
to  D-22,  D-24,  D-26,  D-32, 
D-33 

standby  redundancy,  4-2,  D-6 
to  D-13,  D-16,  D- 17 
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System  life  cycle,  1-4,  1-17,  B-l 
T 

Table  of  organization  and  equipment, 

B  -27 

TAERS,  7-4 

Technical  characteristics  review, 

5-9,  B-  18,  C-20 

Technical,  data  package,  B-24,  B-25 
Technical  development  plan,  1-4, 
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F-38 
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Test  and  checkout  methodology,  C-14, 
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Test  and  demonstration,  2-9,  2-10, 
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special,  6-10,  6-11 
Test  design,  6-17  to  6-22 
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acceptance,  1-3,  2-17,  6-2,  6-4, 
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development,  2-4,  B-19  to 
B-25 

life,  6-2,  7-5,  7-10,  F-30  to 
F -62 

prototype,  1-3 
stress -strength,  6-5,  6-6 
Testing  program,  B-15,  B-25 
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failure  terminated,  6-2,  F-19 
to  F-22,  F-32  to  F-38 
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nonreplacement,  6-2,  F-2  to 
F-4,  F-19  to  F -24,  F-32  to 
F -56,  F-6 1 

replacement,  6-2,  F-19  to 
F-2 3,  F-32  to  F-56 
sequential,  C-31,  F-44  to  F-57 
time  terminated,  6-2,  F-2  to 
F-4,  F-22  to  F-24,  F-38  to 
F-44,  F-57,  F-ol 
Time  terminated  test,  6-2,  F-2  to 
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C-27,  C-28,  C-32 
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Turnaround  time,  3-3,  C-6 
Type  classification,  1-3,  6-7, 

B-24  to  B-27 
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Unacceptable  mean  life,  F-44 
Union  of  set6,  A-3,  A-ll,  A-12 
Use  conditions,  3-10,  E-2 
Utilization  rate,  3-3,  C-ll 
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definition,  A-22 
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gamma.  A- 51 
lognormal,  A-34 
normal,  A-28,  A-29 
poisson,  A-39 
Weibull,  A -48 
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Weibull  distribution 

determination  of,  F-7,  F-8, 
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estimation  of  parameters, 

F-7,  F-8,  F-24  to  F-26 
expected  value,  A-47 
hazard  function,  A-49,  A-50 
probability  density  function, 
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probability  distribution  function, 
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random  variable,  A-46 
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F-24 

variance,  A-48 
Weibull  failure  times 

acceptance  tests,  F-57 
tests  of  hypothesis,  F-56 
Weibull  probability  paper,  F-7,  F-8 
Weighting  factor,  D-25 
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